Data/ETL Engineer
Indexed description
Ascendion | Engineering to elevate life
We have a culture built on opportunity, inclusion, and a spirit of partnership. Come, change the world with us:
- Build the coolest tech for world’s leading brands
- Solve complex problems – and learn new skills
- Experience the power of transforming digital engineering for Fortune 500 clients
- Master your craft with leading training programs and hands-on experience
About The Role
Job Title: Lead Data Engineer
Key Responsibilities
Databricks Engineer – Job Description
The Lead Data Engineer will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks, SQL, AWS/Azure/GCP, and Airflow, combined with a solid foundation in data analysis and engineering best practices. The ideal candidate will collaborate with cross-functional stakeholders and ensure scalable, secure, and high-performing data solutions.
Key Responsibilities
Technical Design
- Develop and maintain data pipelines and ETL workflows using Databricks and Airflow.
- Good understanding of Databricks Delta Live tables, and Unity Catalog
- Build frameworks and templates for ETL/ELT, for telemetry pipelines.
- Ensure cloud-native designs aligned with AWS platform best practices.
- Ensure data quality, integrity, and governance across data platforms.
- Optimize SQL queries and data models for performance and scalability.
- Implement monitoring and observability for data workflows.
- Work closely with architects and leads to understand data requirements and build technical solutions.
- Collaborate with analytics and business teams to deliver actionable insights through BI dashboards and reports
- Familiarity with Agentic AI concepts for automation, data quality validation, and metadata enrichment will be an added advantage.
- 8+years of experience in data engineering, with at least 3 years in Databricks.
- Hands-on expertise in:
- Databricks (PySpark, Spark SQL, Delta Lake, Unity Catalog, Delta Live tables)
- SQL for data modeling and query optimization
- AWS services (S3, Glue, Kinesis, Redshift, API Gateway, SNS, Lambda)
- Airflow for workflow orchestration
- Added advantage – DBT, Splunk, Atlan, Java, API, Power BI
- Strong analytical and problem-solving skills with attention to detail.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search