Databricks Engineering Consultant
Indexed description
Work you'll do
As a Data Engineer II on the AI & Data team, you will be responsible for:
- Designing, developing, testing, and maintaining scalable data pipelines and data products on the Databricks platform using tools such as Auto Loader, Declarative Pipelines, and Structured Streaming
- Building and optimizing Databricks SQL endpoints, data models, and integrations with business intelligence tools to support analytics and reporting
- Supporting the development and deployment of machine learning solutions using Databricks, Unity Catalog, and MLflow
- Advising clients on implementation approaches and operational practices across Databricks data, analytics, and machine learning capabilities
- Implementing end-to-end Databricks solutions across data ingestion, transformation, governance, and deployment on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
Our AI & Data offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offerings help clients innovate, enhance and operate their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.
Qualifications
Required:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
- Must be able to obtain and maintain a US government security clearance
- 2+ years of experience developing and deploying solutions on the Databricks platform
- 2+ years of experience with SQL, Python, and Apache Spark
- 2+ years of experience with at least one major cloud platform: Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
- Ability to travel 25%, on average, based on the work you do and the clients and industries/sectors you serve.
- Databricks Data Engineer Associate, Databricks Data Engineer Professional, or Databricks Data Analyst Associate certification
- Experience supporting government, public sector, or higher education clients
- Active US government security clearance
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
ai&e fy27 profile
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search