Senior Data Engineer

Senior Data Engineer

Job Description

Our client, a leading financial services organisation, is seeking an experienced Senior Data Engineer to join a growing data function. This role will focus on designing and delivering scalable data solutions, supporting advanced analytics initiatives, and helping to drive innovation across a modern cloud-based data platform.

Job Responsibilities

• Design, develop and maintain scalable data pipelines and data integration processes across multiple business systems.
• Build and optimise data warehouse solutions, ensuring efficient data storage, accessibility and performance.
• Develop and maintain transformation and modelling layers to support business intelligence, analytics and reporting requirements.
• Deliver real-time and near-real-time data processing solutions to support operational and analytical workloads.
• Support the development and deployment of AI and machine learning initiatives, including predictive analytics and intelligent automation use cases.
• Collaborate with Compliance, Finance, Product, Engineering and other business stakeholders to define data requirements and deliver high-quality solutions.
• Manage and enhance cloud-based data infrastructure, ensuring reliability, scalability and security.
• Establish and maintain data governance standards, documentation, observability frameworks and data quality processes.
• Evaluate emerging technologies and recommend improvements to the organisation’s data architecture and tooling landscape.
• Support regulatory, reporting and operational data requirements within a regulated environment.

Experience Required

• Minimum 5+ years’ experience in Data Engineering or a related role.
• Expert-level SQL skills with extensive experience working with large-scale datasets and complex analytical workloads.
• Strong Python development experience for data engineering, automation and pipeline development.
• Advanced knowledge of relational database technologies, including performance optimisation, indexing and database administration concepts.
• Minimum 3 years’ experience designing and supporting production-grade orchestration and workflow management solutions.
• Minimum 3 years’ experience working with cloud-based data platforms and services within AWS environments.
• Experience building and supporting real-time data streaming or event-driven architectures.
• Proven ability to design and implement enterprise-scale data platforms and select appropriate tooling across ingestion, transformation, orchestration and observability.
• Exposure to machine learning workflows and production data science environments.
• Experience supporting highly regulated industries with strong governance and compliance requirements.
• Strong stakeholder management skills with the ability to communicate effectively across technical and non-technical audiences.

Desirable Skills

• Experience with DBT or similar data transformation frameworks.
• Knowledge of modern data observability and monitoring platforms.
• Exposure to AI, Large Language Models (LLMs) and Agentic AI technologies.
• Experience implementing data lineage, governance and metadata management solutions.
• Familiarity with infrastructure-as-code tools such as Terraform or CloudFormation.
• Experience working with containerised platforms and cloud-native deployments.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience within financial services, fintech, payments or compliance-driven environments.
• Understanding of data warehouse optimisation techniques and advanced performance tuning.

Educational Requirements

• Bachelor's Degree or equivalent third-level qualification in Computer Science, Software Engineering, Data Engineering, Information Systems or a related discipline.

Working Hours & Benefits

• Competitive salary package.
• Annual performance bonus.
• Pension contribution.
• Healthcare benefits.
• Hybrid working arrangements.
• Professional development and training opportunities.
• Opportunity to work with modern cloud technologies and AI-driven initiatives.
• Career progression within a growing technology function.

How to Apply

To apply for this role, please submit your updated CV. If your skills and experience match job requirements, you will be contacted to discuss your application in detail.

Consultant: Victoria

Similar Roles Open

As a specialised recruitment agency, we also have several other permanent and contract IT, Data and Technology roles available. Visit our website for more information or explore additional opportunities.