AI & Data – Data Engineer
Indexed description
We are looking for an experienced Data Engineer to join our AI & Data team and help build scalable, reliable, and high-performance data solutions.
You will work across data engineering, cloud infrastructure, automation, and DevOps, contributing to modern data platforms and collaborating closely with Data Scientists, Analysts, and Software Engineers.
What you’ll do
- Design, develop, and optimize data models, data warehouses, and lakehouse solutions.
- Build, maintain, and optimize scalable data pipelines and data processing workflows.
- Automate data deployments and infrastructure provisioning using CI/CD and Infrastructure as Code.
- Monitor, troubleshoot, and continuously improve data pipelines and cloud infrastructure.
- Collaborate with Data Analysts, Data Scientists, and Software Engineers to translate business and technical requirements into scalable solutions.
- Contribute to the design and evolution of modern AWS-based data platforms.
- Ensure solutions are reliable, maintainable, secure, and optimized for performance and cost.
What we’re looking for
- 5+ years of experience in Data Engineering, with solid exposure to DevOps and/or Platform Engineering.
- Strong knowledge of SQL and data modelling, including dimensional, normalized, and lakehouse approaches.
- Strong Python skills, with working knowledge of Scala, Java, or Go.
- Hands-on experience with data pipeline and orchestration tools such as Apache Airflow and dbt.
- Experience with distributed data processing frameworks such as Apache Spark, Apache Flink, or similar technologies.
- Strong experience with Infrastructure as Code, particularly AWS CDK and CloudFormation.
- Advanced knowledge of AWS data services, including Glue, EMR, Redshift, Athena, S3, Lambda, and Kinesis.
- Hands-on experience with CI/CD tools, such as GitHub Actions, GitLab CI, Jenkins, or CircleCI.
- Strong problem-solving skills and the ability to work effectively in a collaborative, cross-functional environment.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search