Senior Data Engineer (All genders)
Indexed description
What You Can Expect
- You will gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks.
- You will work on fast paced and innovative projects with the goal to deliver innovative solutions for our customers.
- You will design, implement, and manage scalable data pipelines using cloud-native technologies to efficiently process and analyze large volumes of data.
- You will evaluate and implement new technologies and tools in the area of data engineering to continuously improve the efficiency and performance of our data processing processes.
- You will work closely with Data Scientists and Analysts, identifying potential data sources and evaluating their utility to understand data requirements and develop appropriate solutions.
- Additionally you will share your expertise and experience with other team members, contribute to knowledge sharing and development of the team.
- Finally you will develop and maintain documentation on data engineering processes, best practices and technologies.
- 8+ years of hands-on experience in Data Engineering, working with large-scale data pipelines and cloud platforms.
- Strong programming skills in Python (or another modern programming language) and SQL, with experience using distributed data processing frameworks such as PySpark or Spark SQL.
- Proficient in building and deploying cloud-native data pipelines on at least one major cloud (Azure or AWS).
- Experience with cloud-based data services, such as Azure Data Factory, Azure Databricks, AWS Glue, or similar orchestration and processing tools.
- Strong background in data integration, ETL/ELT development, data modeling, and data architecture.
- Experience working in Unix/Linux environments, including writing Bash scripts for automation and operations.
- Familiarity with AWS data and compute services, such as S3, Glue, IAM, Redshift, Lambda, VPC, and DynamoDB.
- Exposure to CI/CD practices and Infrastructure-as-Code using Terraform, Azure DevOps, GitHub Actions, or similar tools.
- Understanding of streaming technologies, such as Kafka, Azure Event Hubs, or AWS Kinesis.
- Experience working within Agile delivery environments.
Professional & Personal Growth: Develop yourself both professionally and personally through training programs, free language courses, competence centers and an active tech community.
Flexible Work-Life Balance: Benefit from hybrid work, workation, flexible hours, parental support and sabbaticals.
Embrace Diversity & Sustainability: Engage in our Sustainability Hub, diverse communities, Diversity Taskforce and after-work activities.
Comprehensive Benefits: Enjoy public transport tickets, job bikes, access to exclusive Volkswagen employee conditions when leasing or purchasing a vehicle, health offers, supplementary insurances, a pension plan and various discounts.
What We Value
At Diconium, we value and recognize the unique perspectives and experiences of each individual. With this in mind, we welcome and cherish every single application equally. At the same time, we stand up against any type of discrimination and harassment based on gender, age, skin color, religion, sexual orientation, origin, disability, gender identity and other protected characteristics.
If you have any questions, feel free to reach out.
Your contact person is
Elena, [email protected]
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search