Back to search
TechWish Linkedin · Posted 1mo ago

Azure Data Engineer

New York, United States

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Required Qualifications & Experience

  • Bachelor's degree in computer science, Information Technology, Engineering, or a related discipline, with 6-10 years of experience in Data Engineering, Application Development, System Integration, or Enterprise Data Warehouse projects.
  • Strong hands-on experience designing and implementing modern data platforms on Azure Databricks, leveraging Delta Lake, Delta Live Tables (DLT), and Medallion Architecture (Bronze, Silver, Gold) to build scalable and reliable data pipelines.
  • Proven expertise in developing and optimizing batch and streaming data pipelines using PySpark, Spark SQL, and Python, with a strong focus on performance tuning, scalability, and cost optimization.
  • Extensive experience in Databricks job performance optimization, including query tuning, partitioning strategies, data skew mitigation, caching, cluster sizing, workload optimization, and Spark execution plan analysis.
  • Strong proficiency in SQL programming and data modeling concepts, including relational, dimensional, and lakehouse data architectures.
  • Deep understanding of Delta Lake features such as ACID transactions, schema evolution, time travel, change data capture (CDC), and data quality enforcement.
  • Experience implementing data quality, monitoring, and orchestration frameworks using Delta Live Tables expectations, Databricks Workflows, and Azure-native services.
  • Strong exposure to the full Software Development Life Cycle (SDLC), including design, development, testing, CI/CD, deployment, and production support.
  • Solid understanding of Lakehouse architecture, cloud-based analytics platforms, data governance, and data engineering best practices.
  • Knowledge of real-time data processing, data integration patterns, and enterprise-scale data migration initiatives is a strong advantage.
  • Demonstrated ability to stay current with evolving cloud and big data technologies and contribute effectively to architecture discussions, technology strategy, and platform modernization initiatives.
  • Self-motivated, proactive, and capable of working independently in a fast-paced environment while collaborating with globally distributed teams.
  • Strong analytical, problem-solving, communication, and stakeholder management skills.
Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search