Senior Associate Data Engineer - AI & Data Platforms
Indexed description
This role combines hands-on software and data engineering with technical design leadership. Work is hands-on and design-oriented in equal measure, requiring you to contribute directly to implementation while also owning critical technical decisions, architecture designs, and engineering standards. As enterprise platforms increasingly enable intelligent products and services, you will also build data services and platform capabilities that incorporate AI and LLM-based solutions where they provide measurable business value.
Qualifications
Skills & Experience
- 6+ years of experience in Data Engineering, Data Platform Engineering, or related fields with ownership of production systems.
- Advanced Python and SQL development experience in enterprise environments.
- Strong hands-on experience with Spark or PySpark for large-scale distributed data processing.
- Deep expertise in AWS or Azure and practical experience working within a second cloud ecosystem.
- Strong data modeling capabilities including Star Schema, Snowflake Schema, Slowly Changing Dimensions (SCD Type 2), Medallion Architecture, and Lakehouse patterns.
- Experience designing and implementing CI/CD pipelines, automated testing, and deployment practices for data platforms and services.
- Strong relational database engineering and schema design experience.
- Experience building production-grade data services, APIs, or backend components.
- Proven experience designing, integrating, or operating AI and LLM-enabled solutions in enterprise environments.
- Proven ability to author, communicate, and defend technical designs with engineering stakeholders.
- Demonstrated ability to balance solution design responsibilities with hands-on implementation and delivery ownership.
- Experience building AI-enabled data products using LLM APIs, Retrieval-Augmented Generation (RAG), embeddings, semantic search, or vector databases.
- Experience developing backend services and APIs using FastAPI or similar frameworks.
- Experience working with regulated data domains requiring compliance, privacy, governance, and auditability controls.
- Familiarity with metadata management, cataloging, lineage, and enterprise data governance tooling.
- Experience supporting large-scale cloud modernization and migration initiatives.
- Experience operating and delivering solutions across both AWS and Azure environments.
- Knowledge of MLOps, model evaluation frameworks, and AI observability practices.
- An inclusive workplace that promotes diversity and collaboration.
- Access to ongoing learning and development opportunities.
- Competitive compensation and benefits package.
- Flexibility to support work-life balance.
- Comprehensive health benefits for you and your family.
- Generous paid leave and holidays.
- Wellness program and employee assistance.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search