Lavance LLC
Linkedin · Posted 1mo ago
Azure Data Engineer
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure services.
- Build ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
- Develop data transformation logic using PySpark, Spark SQL, and Python.
- Manage Delta Lake and Lakehouse architectures.
- Optimize SQL queries and Spark workloads for performance.
- Integrate data from APIs, databases, and third-party applications.
- Implement data quality, validation, and monitoring processes.
- Collaborate with analysts, data scientists, and business stakeholders.
- Implement CI/CD pipelines using Azure DevOps.
- Ensure data security, governance, and compliance.
- Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, PySpark, Python, SQL, Delta Lake, Git, Power BI, REST APIs
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search