Data Engineer
Indexed description
Data Engineer (Python / SQL / Microsoft Fabric)
Location: Newcastle upon Tyne | 3 Days onsite
Type: Full-time, Permanent
Overview
A large Newcastle based organisation is looking to appoint a hands-on Data Engineer to join its established and growing Data team.
This role is particularly focused on strong commercial Python and SQL experience. You'll be responsible for building and maintaining data pipelines, ingesting and transforming data from multiple systems and developing reliable datasets that support Analytics, Data Science and wider business teams.
The environment is continuing to evolve towards modern cloud Data Engineering technologies,
including Microsoft Fabric and Python notebooks. You don't need to already be an expert across every part of the Microsoft data stack, but you should have strong Data Engineering fundamentals and be confident using Python and SQL within real commercial environments.
Key Responsibilities
• Build, maintain and optimise data pipelines and ingestion processes
• Use Python to transform, process and manipulate data
• Write complex, efficient SQL queries and procedures
• Develop solutions increasingly using Python notebooks
• Build ETL and ELT processes across multiple data sources
• Support data warehouse and dimensional modelling solutions
• Transform transactional data into structures suitable for analytics and reporting
• Work with Microsoft Fabric and wider Azure data technologies
• Monitor pipelines and resolve data quality, reliability and performance issues
• Collaborate with Analytics, Data Science and business teams to deliver practical engineering solutions
Requirements
• Strong commercial Python experience within Data Engineering
• Strong commercial SQL experience, including complex queries and data transformations
• Experience building and maintaining data pipelines
• Commercial experience with ETL and/or ELT development
• Experience ingesting and transforming data from multiple source systems
• Understanding of data warehousing and dimensional modelling
• Good understanding of data quality, validation and reliable data processing
• Strong problem-solving skills and a genuine Data Engineering mindset
Desirable
• Microsoft Fabric experience
• PySpark, Spark or Databricks exposure
• Azure Data Factory or Azure Data Lake experience
• Experience with Python notebooks
• Understanding of OLTP and OLAP architectures
What’s on Offer
• Hybrid working after probation
• Exposure to Microsoft Fabric and modern Azure data technologies
• Opportunity to develop further with Python notebooks and cloud Data Engineering
• Genuine progression opportunities within an established Data team
• Collaborative environment working alongside Analytics and Data Science professionals
Apply
If you're a Data Engineer with strong commercial Python and SQL skills and want to continue developing within a modern Microsoft data environment, apply now or get in touch for a confidential discussion.
We're particularly interested in people who see themselves as Data Engineers rather than primarily Data Analysts or BI professionals.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search