TECHNICAL LEAD - Azure Databricks
Indexed description
Years of Experience: 10-13 Years
Job Summary: The Onshore Data Lead will drive end-to-end delivery of a large-scale data platform migration to Databricks, ensuring alignment with business objectives, data governance standards, and enterprise architecture. This role will act as the primary interface between business stakeholders, offshore delivery teams, and client leadership while ensuring high-quality, timely, and cost-effective execution.
Responsibilities
- Lead and manage end-to-end project lifecycle for data analytics projects utilizing Azure Databricks.
- Collaborate with stakeholders to define project scope, objectives, and deliverables.
- Monitor project progress and performance, ensuring adherence to timelines.
- Facilitate communication between offshore technical teams and business stakeholders to ensure alignment on project goals.
- Identify and mitigate project risks and issues proactively.
- Provide regular project updates and reports to offshore management and stakeholders.
- Mentor and guide junior team members.
- Strong experience in data platforms (Cloudera, Hadoop, or cloud-native platforms)
- Experience with cloud computing platforms and data engineering.
- Hands-on exposure to Databricks (Spark, Delta Lake, notebooks, workflows)
- Experience with cloud platforms (Azure / AWS / GCP)
- Understanding of ETL/ELT pipelines, data warehousing, and big data ecosystems
- Knowledge of data governance, security, and compliance
- Strong expertise in Azure Databricks, including data processing, analytics, and machine learning capabilities.
- Familiarity with data visualization tools (e.g., Power BI, Tableau).
- Knowledge of programming languages such as Python or Scala.
- 10+ years in data engineering / analytics programs with 3?5 years in leadership roles
- Proven experience working in large-scale data migration or transformation programs
- Strong stakeholder management and communication skills
- Ability to translate business requirements into technical solutions
- Experience in working with distributed (onshore-offshore) teams
- Excellent communication and interpersonal skills.
- Ability to manage multiple projects simultaneously and prioritize effectively.
- Strong analytical and problem-solving skills.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 10-13 years of experience in Software Development, with a focus on data analytics and Azure Databricks.
- Demonstrated ability to lead cross-functional teams and manage stakeholder expectations.
- Strong understanding of data architecture and data governance principles.
Databricks
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search