Databricks Developer
Indexed description
- Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
- Build and optimize Delta Lake architectures for high-performance data processing
- Develop and deploy AI/ML models and advanced analytics solutions
- Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
- Develop BI and analytics datasets for downstream reporting and visualization
- Collaborate with business and data science teams to translate requirements into solutions
- Optimize performance, cost, and scalability of data pipelines on cloud platforms
- Ensure data quality, governance, and compliance standards are met
- Excellent problem-solving and communication skills.
We are seeking an experienced Databricks Developer to design, develop, and optimize scalable data and AI-driven solutions on cloud platforms. The role requires strong expertise in data engineering, machine learning, and modern analytics leveraging Databricks and AI frameworks.
Key Responsibilities
- Design and develop scalable data pipelines and ETL workflows using Databricks (Spark, PySpark)
- Build and optimize Delta Lake architectures for high-performance data processing
- Develop and deploy AI/ML models and advanced analytics solutions
- Implement Agentic AI / GenAI solutions using Databricks (e.g., Agent Bricks, LLM-based workflows)
- Develop BI and analytics datasets for downstream reporting and visualization
- Collaborate with business and data science teams to translate requirements into solutions
- Optimize performance, cost, and scalability of data pipelines on cloud platforms
- Ensure data quality, governance, and compliance standards are met
- Strong hands-on experience with Databricks (Workflows, Delta Lake, Unity Catalog)
- Expertise in ETL/Data Engineering using Spark/PySpark
- Experience with AI/ML model development and deployment
- Knowledge of Agentic AI / GenAI frameworks and LLM integration
- Strong understanding of cloud platforms (AWS / Azure / GCP)
- Experience with BI tools (Power BI, Tableau, etc.)
- Proficiency in SQL, Python
Qualifications: BACHELOR OF COMPUTER SCIENCE
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search