Senior Data Engineer
Indexed description
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and data infrastructure to support analytics, reporting, and data-driven decision-making across the organization
- Design, develop, and maintain robust and scalable data pipelines (ETL/ELT processes) to support business and analytics needs
- Ensure data quality, integrity, and consistency across multiple data sources
- Integrate data from various internal and external systems and support real-time and batch data processing.
- Collaborate with data analysts, data owners and business stakeholders to understand data requirements and deliver solutions
- Monitor and optimize data pipeline performance, ensuring efficiency, reliability and resolving data-related issues.
- Document data processes, architecture, and standards for maintainability
Qualifications:
- Bachelor’s degree in computer science, Information Technology or a related field
- 7 years of experience in data engineering or related roles
- Experience with programming languages (e.g. Python). Strong proficiency in SQL and data modeling concepts
- Hands-on experience with ETL/ELT tools (e.g. Airflow) and data pipeline development.
- Experience working with large-scale datasets and distributed systems
- Experience with cloud platforms (e.g. Google Cloud) and data services (e.g. BigQuery)
- Familiarity with BI tools (e.g. Power BI, Qilkview, Google Looker)
- Strong analytical and problem-solving skills
- Good communication and collaboration abilities
- Experience with real-time data streaming (e.g. Kafka, Google Pub-Sub) as a plus
- Knowledge of data governance and data security best practices
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search