Azure Data Lead (PySpark Mandatory)

We are looking for an experienced Azure Data Lead with strong expertise in Python/PySpark, capable of driving complex data engineering initiatives and delivering scalable data solutions within Azure environments.

💼 Key Responsibilities

• Design and implement complex ETL processes and data workflows
• Develop and optimize data pipelines using PySpark (mandatory)
• Work extensively with Azure Databricks and Azure data ecosystem
• Handle large-scale data processing, transformation, and integration
• Contribute to architecture decisions across storage, processing, and visualization layers
• Ensure performance, scalability, and reliability of data solutions

✅ Must-have Requirements

• Strong expertise in Python/PySpark frameworks and libraries – mandatory
• Hands-on experience with Azure Databricks (minimum 7 years)
• Strong SQL expertise (minimum 7 years)
• Proven experience in designing and implementing complex ETL and process flows (minimum 7 years)
• Solid expertise across data transformation (ETL) frameworks
• Good understanding of underlying data systems (storage, processing, visualization)

➕ Nice to have

• Experience with Azure Data Factory (ADF)
• Ability to read and interpret database execution plans
• Knowledge of Azure / Azure DevOps
• Experience with CI/CD, configuration management, and cloud implementations on Azure
• Azure certifications

HCLTech is a global technology company, home to 219,000+ people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Our purpose is to bring together the best of technology and our people to supercharge progress. We’re supercharging progress for everyone, everywhere – our clients, partners and their stakeholders, our people, communities, and the planet.

HCLTech is committed to protecting and securing the privacy and confidentiality of the Personal Data which it collects directly or indirectly from you when applying for a job at HCLTech either directly or through a third-party human resources agency. This notice (the “Notice”) outlines and explains how HCL Technologies Limited including its subsidiaries, local employing entities, associates, and affiliated companies [collectively referred to as “HCLTech”, “us,” “our”, or “we”] will process your Personal Data in accordance with applicable privacy legislation(s).

Candidate Data Privacy Notice | HCLTech