Databricks Data Engineer
Indexed description
YOUR PROJECT
Insights & Data is a thriving team of over 400 professionals focused on delivering advanced data-driven solutions. Our expertise lies in Cloud & Big Data engineering, where we build scalable architectures for processing large and complex datasets across AWS, Azure, and GCP. We manage the entire Software Development Life Cycle (SDLC), leveraging modern data frameworks, programming methodologies, and DevOps best practices to create impactful and efficient solutions.
YOU WILL
- Design and implement data processing solutions using Databricks for large-scale and diverse datasets.
- Design, build, and enhance data pipelines with Python and cloud-native tools.
- Work closely with solution architects to define and uphold best practices in data engineering.
- Ensure data consistency, security, and scalability within cloud-based environments.
- Strong experience in data engineering, with at least 1 year of hands-on Databricks expertise.
- Strong experience in Python for automation and data transformation.
- Experience working with at least one major cloud platform (AWS, Azure, or GCP).
- Strong communication skills and strong English language skills.
- Solid understanding of SQL with experience in query optimization and data modeling.
- Familiarity with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).
- Experience with real-time data streaming technologies such as Kafka or Spark Streaming.
- Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse.
- Hands-on experience with PySpark for distributed data processing.
- Relevant certifications such as Databricks Certified Data Engineer Associate or cloud-based data certifications.
- Access our education library with 250,000+ courses, certifications, and learning resources;
- Well-being Hub: The global Well-Being Hub connects employees across various facets of well-being: work-life balance, working hours and network growth;
- We value flexibility – hybrid work and flexible hours help you maintain a healthy work-life balance;
- We also offer additional benefits such as Employee referral bonus and Company shares program;
https://www.capgemini.com/about-us/technology-partners/databricks/
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search