Sr. Databricks Consultant - Top Secret Clearance
Indexed description
This role will support ECS’s Professional Services and Managed Cybersecurity Services programs, with a focus on Databricks solutions. You will specialize in data pipeline optimization, scalable model training, and advanced analytics on Databricks, offering you a unique opportunity to work with leading-edge technologies and collaborate with clients to deliver measurable improvements in data-driven decision-making. If you are passionate about applying data science techniques within the Databricks ecosystem to solve real-world challenges, we encourage you to apply.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
- Optimize workflows and clusters for performance and cost efficiency.
- Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
- Implement data governance, security, and compliance standards.
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
- Troubleshoot issues and drive continuous improvement in data infrastructure.
- Active Top Secret Clearance
- Proven experience working with Databricks in production environments.
- Strong proficiency in Python and/or SQL for data engineering.
- Experience with Apache Spark for distributed data processing.
- Knowledge of data lakehouse architecture and best practices.
- Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
- Hands-on experience building and managing ETL/ELT pipelines.
- Strong understanding of data modeling, data quality, and performance tuning.
- Familiarity with CI/CD pipelines and version control (Git).
- Ability to travel, as needed, to customer sites.
- Must be a US Citizen per contract.
- Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.
- Master's degree or PhD in Computer Science, Data Science, or a related field
- Experience with machine learning pipelines in Databricks (MLflow).
- Knowledge of Delta Lake and Unity Catalog for governance.
- Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
- Exposure to data visualization tools (Tableau, Power BI, or Looker).
- Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
- Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
- Strong understanding of DevOps/MLOps practices.
- Prior consulting or customer-facing experience
- Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments.
Our work powers mission-critical outcomes, strengthens technology partnerships, and creates meaningful opportunities for our people. We are defined by a commitment to excellence in delivery, a culture of innovation, and an environment where talent can thrive and grow.
We Value
- Attracting and developing top talent and high-performing teams
- Fostering a culture that is engaging, accountable, and mission-driven
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search