Lead Data Engineer

Lead Data Engineer - 1 year contract - NV1 Clearance Required

Your new company

This organisation is seeking an experienced Lead Data Engineer to join a growing data and analytics team responsible for delivering enterprise-scale data solutions that support strategic decision-making and advanced analytics initiatives. Operating within a modern Azure cloud environment, you will play a key role in architecting and delivering scalable data platforms, mentoring team members, and driving best-practice data engineering across the organisation.

Your new role

As a Senior Data Engineer, you will lead the design, development and optimisation of data pipelines, data models and analytics solutions within a complex enterprise environment. You will work closely with business stakeholders, data analysts, data scientists and technical teams to ensure the delivery of trusted, high-quality data assets that support operational and strategic outcomes.

Key responsibilities include:

• Leading the design, development and maintenance of scalable ETL/ELT data pipelines for enterprise data integration and analytics.
• Architecting and optimising data models, data products and curated datasets to support reporting, operational insights and advanced analytics.
• Developing and maintaining data lineage, governance frameworks and technical documentation.
• Driving continuous improvement initiatives across data ingestion, transformation and data flow processes.
• Establishing and enforcing data quality standards, monitoring frameworks and validation controls.
• Investigating and resolving complex data issues through root cause analysis and implementation of sustainable solutions.
• Providing technical leadership and guidance on modern data engineering best practices, standards and frameworks.
• Supporting platform development, automation, testing, deployment and performance optimisation activities.
• Collaborating with analysts, data scientists and business stakeholders to translate business requirements into scalable data solutions.
• Communicating technical concepts and recommendations to both technical and non-technical audiences.
• Mentoring junior engineers and contributing to the ongoing development of team capability.

What you'll need to succeed

To be successful in this role, you will have:

• Significant experience working as a Data Engineer or Senior Data Engineer within large-scale enterprise environments.
• Strong experience designing and implementing ETL/ELT pipelines and cloud-based data solutions.
• Advanced hands-on experience with:
• Azure Data Factory
• Azure Databricks
• Python (PySpark)
• SQL
• Power BI
• Extensive experience building data models, semantic layers and curated datasets for analytics and reporting.
• Strong understanding of data governance, data lineage, data quality and metadata management principles.
• Experience optimising large-scale data platforms for performance, scalability and reliability.
• Strong stakeholder engagement skills with the ability to influence technical and business audiences.
• Experience working within Agile delivery environments.
• Demonstrated ability to lead technical initiatives and mentor other team members.

What you'll get in return

• Opportunity to lead enterprise-scale Azure data and analytics initiatives.
• Exposure to modern cloud and big data technologies.
• A collaborative and high-performing data team environment.
• Opportunity to influence architecture, standards and engineering best practices.
• Flexible working arrangements and competitive remuneration package.
• Strong career progression opportunities within a growing data function.