Azure Data factory engineer
Indexed description
Role: Senior Data Engineer – Matillion to Azure Migration
Key Responsibilities
- Lead end-to-end migration strategy and execution from Matillion (Snowflake/Redshift) to Azure Data Factory, Synapse, and ADLS Gen2
- Analyse and convert Matillion ETL workflows (SQL, Python-based) into:
- ADF pipelines
- Mapping Data Flows
- Databricks notebooks
- Design and develop scalable, high-performance data pipelines on Azure
- Drive performance optimisation to reduce ETL runtime and cost
- Implement data quality checks, validation frameworks, and error handling
- Produce technical documentation including mapping, data flow designs, and migration strategy
Mandatory Skills:
- Strong hands-on experience with Matillion ETL
- Strong hands-on experience with Azure Data Factory (ADF)
- Extensive experience in SQL (complex queries, performance tuning, stored procedures)
- Proven experience with Azure ecosystem:
- Azure Synapse Analytics
- ADLS Gen2
- Azure Databricks
Experience:
- 10–15+ years in ETL/Data Engineering & Data Warehousing
- Strong stakeholder communication and collaboration skills
- Experience in Python / PySpark for data processing
- Experience with Git and Azure DevOps (CI/CD pipelines)
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search