Lead Data Engineer
Indexed description
Job Title: Lead Data Engineer
Location: UAE (Dubai Preferred) – On-site
Experience: 11+ Years
Employment Type: Full-time
Immediate Joiners Preferred
We are hiring an experienced Lead Data Engineer for a large-scale Data Lakehouse modernization program with a leading retail group operating across the UAE and GCC region.
This role involves building a modern, scalable Data Lakehouse platform that will serve as the single source of truth for enterprise reporting, analytics, and future AI/ML initiatives.
Key Responsibilities
- Build and manage end-to-end data ingestion pipelines from multiple enterprise systems
- Implement CDC pipelines for real-time and near-real-time data processing
- Develop Bronze, Silver, and Gold transformation layers with business rules and data enrichment
- Design orchestration workflows with monitoring, alerting, and SLA tracking
- Implement data quality frameworks, governance, and security controls
- Enable reporting and analytics consumption layers for BI and downstream integrations
- Support historical data migration from legacy cloud data warehouse platforms
- Build scalable pipelines supporting AI/ML feature engineering and model training
Required Skills & Experience
- 11+ years of hands-on experience in Data Engineering and Lakehouse environments
- Strong expertise in Python and PySpark
- Experience with AWS data services, Glue, EMR, DMS, Kinesis/Event Hubs, or equivalent
- Strong CDC implementation experience using Debezium, DMS, or similar tools
- Hands-on experience with Delta Lake, Apache Iceberg, or Hudi
- Strong dbt and SQL skills
- Expertise in orchestration tools such as Airflow, Dagster, or Step Functions
- Experience with data quality frameworks like Great Expectations or Deequ
- Strong understanding of IAM, PII masking, row-level and column-level security
- Experience in dimensional data modeling for BI reporting
Preferred Skills
- AWS, Databricks, Snowflake, Microsoft Fabric, BigQuery
- Retail / E-commerce domain experience
- Exposure to AI/ML data pipeline requirements and feature engineering
- Relevant cloud or Databricks/Snowflake certifications preferred
Preferred Candidate
- Immediate joiners only
- Indian Origin Only
- Strong hands-on engineering and architecture experience
- Ability to work in a fast-paced on-site environment
Interested candidates can share their updated resume at:
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search