Lead Data Engineer II
Indexed description
Work you'll do
As a Lead Data Engineer II on the AI & Data team, you will be responsible for...
- Designing, building, and optimizing batch and streaming data pipelines for large-scale data platforms
- Translating business, functional, and technical requirements into scalable data models, integration patterns, and engineering solutions
- Leading technical delivery across data engineering workstreams, including code reviews, design decisions, and release support
- Integrating data from multiple enterprise source systems and cloud environments to support reporting, analytics, and artificial intelligence use cases
- Supporting testing, deployment, monitoring, and issue resolution to improve reliability, performance, and data quality
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to mentor and provide clear guidance to others
Our AI & Data offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offerings help clients innovate, enhance and operate their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.
Qualifications
Required:
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a technical field, or equivalent experience
- 6+ years of experience designing, building, and maintaining data pipelines and cloud-based data platforms
- 4+ years of experience with Python, Structured Query Language, and distributed data processing frameworks
- 3+ years of experience with Amazon Web Services, Microsoft Azure, or Google Cloud Platform
- 2+ years of experience leading data engineering workstreams and delivering production data solutions using version control and deployment pipelines
- Ability to travel 25%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
- 2+ years of experience with Databricks, Snowflake, or comparable cloud data platforms
- 2+ years of experience building orchestration workflows using Apache Airflow or comparable tools
- 2+ years of experience delivering data engineering solutions for government or public sector organizations
- 2+ years of experience with data governance, data quality, or metadata management tools
- 1+ cloud data engineering certification in Amazon Web Services, Microsoft Azure, or Google Cloud Platform
- 2+ years of experience supporting artificial intelligence or machine learning use cases through production data pipelines
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search