Data Engineer

Role: Data Engineer (10-15 years of experience)

Location/Domain Requirement: Candidates must be based in the UAE and have banking domain experience.

Role Overview

We are seeking a highly skilled and motivated Data Engineer with 10 years of experience to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have strong expertise in SQL, Databricks, Confluent (Kafka), Azure Data Factory (ADF), and

Azure Data Lake Storage (ADLS), with a solid understanding of banking domain processes and regulatory considerations. This role involves working closely with cross-functional teams to enable data-driven decision-making across critical banking functions.

Mandatory Skills

✔ Azure Databricks (Spark/PySpark)

✔ Confluent Kafka (Real-time Streaming)

✔ Azure Data Factory (ADF)

✔ Azure Data Lake Storage (ADLS)

✔ Advanced SQL & Data Modeling

✔ Banking Domain Experience (Mandatory)

What We're Looking For

• Experience designing end-to-end Azure data architectures using Databricks, ADF, and ADLS.
• Strong knowledge of Medallion Architecture (Bronze, Silver, Gold) and Delta Lake.
• Expertise in Spark performance tuning, partitioning, shuffle optimization, and handling large-scale distributed workloads.
• Hands-on experience building real-time streaming pipelines with Kafka.
• Understanding of data governance, security, lineage, and regulatory compliance in banking (KYC/AML, General Ledger, audit requirements).
• Experience with workflow orchestration (ADF/Airflow), CI/CD, and enterprise-scale data platforms.