Data Engineer (DataLake) - All levels
Indexed description
Role Summary
As a Data Engineer (Intermediate/Senior), you will work closely with Data Architects, Business Analysts, BI developers, and client technology teams to design and implement reusable data ingestion and transformation pipelines in Data Lake/Lakehouse implementation programme
What You’ll Do
- Developing batch, CDC and/or streaming data ingestion pipelines from multiple source systems.
- Implementing Bronze, Silver and Gold data layers, including data cleansing, transformation and standardisation.
- Developing reusable data pipelines and supporting data product implementation.
- Implementing data quality, reconciliation, validation and monitoring controls.
- Supporting data migration, integration testing, UAT and production release.
- Working with the architecture team to ensure solutions follow agreed cloud, security, governance and engineering standards.
- Supporting knowledge transfer and BAU handover.
- 4+ years of experience in data engineering or related roles.
- Strong experience in Databricks, Azure, SQL, Python/PySpark, ETL/ELT, Delta Lake, data modelling, data quality and CI/CD.
- Experience in financial services especially asset management or large-scale data transformation, would be advantageous.
- Experience in workong on an end-to-end enterprise data transformation, from source ingestion through to governed data products and business reporting.
- Experience in asset management company, fintech, or other regulated industries.
- Work on engaging projects with some of the largest banks/insurance in the world, on projects that will transform the financial services industry
- Work in a collaborative, flat, and entrepreneurial consulting culture
- Access continuous learning, training, and industry certifications
- Be part of a team shaping the future of digital financial services
- Help shape the future of digital transformation across FS & Energy
- A work culture focused on innovation and creating lasting value for our clients and employees
- Ongoing learning opportunities to help you acquire new skills or deepen existing expertise in our financial services offerings
- A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
- An agile, diverse, entrepreneurial, inclusive, meritocratic culture
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search