Data Engineer

We are looking for an experienced Data Engineer to design, build, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate will have strong expertise in Azure Data Services, Databricks, and Big Data technologies, with a passion for transforming complex data into valuable business insights.

You will work closely with cross-functional teams to develop robust data pipelines, integrate new data sources, and support enterprise analytics initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and Apache Spark.
• Integrate structured, semi-structured, and unstructured data from multiple sources into enterprise data platforms.
• Build reusable ETL/ELT processes to ensure reliable, high-quality data for reporting and analytics.
• Collaborate with business and technical teams to understand data requirements and deliver efficient data solutions.
• Optimize data models, pipeline performance, and storage for scalability and reliability.
• Implement CI/CD practices using Azure DevOps to automate deployments.
• Support data quality, governance, and platform performance while ensuring adherence to best practices.
• Create technical documentation and contribute to continuous improvement of the data platform.

Required Skills

• Strong experience with Microsoft Azure Data Services, including Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
• Hands-on expertise in Apache Spark, Python, SQL, and Scala.
• Experience designing and optimizing ETL/ELT pipelines and Big Data architectures.
• Knowledge of Event Hub, Azure Functions, Docker, Kubernetes (AKS), and REST APIs.
• Familiarity with Power BI and Azure DevOps for deployment and automation.
• Strong analytical, problem-solving, and communication skills.

Qualifications & Experience

• Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field.
• 5–7 years of experience as a Data Engineer in enterprise environments.
• Proven experience delivering Azure-based data engineering solutions in production environments.
• Experience working with large-scale data platforms and modern cloud-based architectures is highly preferred.

Preferred Competencies

• Strong analytical and troubleshooting skills.
• Excellent communication and stakeholder management abilities.
• Collaborative team player with a proactive mindset.
• Ability to thrive in a fast-paced, agile environment while delivering high-quality solutions.