abra
Linkedin · Posted 8d ago
Data engineer
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
abra professional services is seeking a talented Data Engineer!We are looking for a Data Engineer to join our team and work on cutting-edge AI projects.
In this role, you will be responsible for ingesting large volumes of new data, as well as deeply understanding and analyzing it in close collaboration with our Data Scientists. You will design and develop critical, diverse, and large-scale data pipelines across both Cloud and On-Premises environments.
Requirements:
- Education: B.Sc. in Computer Science, Engineering, Mathematics, or Statistics – Must.
- Experience: 3+ years of hands-on experience as a Data Engineer – Must.
- Programming: 3+ years of experience with Python and Object-Oriented Programming (OOP) – Must.
- Big Data: Proven practical experience with Spark for large-scale data processing – Must.
- Deep understanding of designing, developing, and optimizing complex high-volume data systems.
- Familiarity with data formats and optimization/partitioning techniques (Parquet, Avro, HDF5, Delta Lake).
- Solid conceptual and practical understanding of Docker, Linux, CI/CD tools, and Kubernetes.
- Experience with data pipeline orchestration tools such as Airflow or Kubeflow.
- Understanding of core Machine Learning concepts and workflows.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent
