Senior Data Engineer

Curious about an exciting opportunity to develop your career as a Data Engineer?

We’re looking for someone with technical skills but also a great attitude, who is proactive, takes pride in the quality of their work and is eager to continually improve their technical skills. We welcome applications from varied technical backgrounds including but not limited to: data science, infrastructure engineering, software engineering or related technical disciplines.

Responsibilities:

• Work across the lifecycle of ETL/ELT (extract, transform, load / extract, load, transform) pipelines that facilitate the movement and transformation of data across our systems.
• Conduct data profiling and analysis to assess data quality, identify anomalies, and uncover insights that inform data pipeline design and business decision-making.
• Develop and maintain internal software packages for Data Engineering. Use tools across ourtech-stacks, such as SQL, Python, PySpark, Cloudera Data Platform, Google Cloud Platform.
• Optimise the performance of our queries and data pipelines. Collaborate with various technical and business stakeholders to develop and deliver on requirements, to ensure our data and processes meet business needs.
• Set, follow and ensure adherence to standard ways of working and good practice in Data Engineering. Ensure governance and compliance of our data and processes in line with ONS policies and wider legal requirements.
• Contribute to the evaluation and adoption of new tools, frameworks, and technologies that enhance the data engineering ecosystem.
• Champion the role of Data Engineers within ONS and participate in ONS and Civil Service Data Engineering communities.
• Take an active role in building the capability of Data Engineers within ONS