Data Engineer (Databricks)
Indexed description
We’re looking for an experienced Data Engineer to join our team and work on enterprise-scale data engineering initiatives, building scalable and reliable data pipelines and modern data solutions.
⚠️ IMPORTANT: DATABRICKS EXPERIENCE IS A MUST-HAVE FOR THIS ROLE.
🔎 What You’ll Be Doing
• Design, develop, and maintain scalable data pipelines and ETL/ELT processes
• Build and optimize data engineering solutions using Databricks
• Work with large-scale datasets using Apache Spark / PySpark
• Develop complex data transformations using SQL and Python
• Build and maintain reliable batch and/or real-time data pipelines
• Work with Delta Lake and Lakehouse architecture
• Optimize data pipelines and Spark workloads for performance and scalability
• Implement data quality, monitoring, and data governance practices
• Collaborate with Data Architects, Data Scientists, Analysts, Developers, and business stakeholders
• Participate in technical design, code reviews, testing, deployment, and production support
• Help drive data engineering best practices and provide technical guidance to other engineers
🧩 What We’re Looking For
✅ 8–10 years of experience in Data Engineering
✅ Strong hands-on experience with Databricks – MUST HAVE
✅ Strong experience with Apache Spark / PySpark
✅ Advanced SQL skills
✅ Strong Python programming experience
✅ Solid experience in ETL/ELT and data pipeline development
✅ Experience working with large-scale/distributed data processing
✅ Strong understanding of data warehousing and data modeling
✅ Experience with cloud-based data platforms
✅ Experience with Git and CI/CD practices
✅ Strong analytical and problem-solving skills
⭐ Strong Advantage If You Have
• Azure Databricks experience
• Delta Lake / Lakehouse experience
• Databricks Workflows
• Unity Catalog
• Delta Live Tables (DLT)
• Azure Data Factory or equivalent cloud data integration tools
• Experience implementing CI/CD for Databricks/data engineering workloads
• Experience with data governance and security
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search