Senior Data Engineer

Job description

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders.

Your role at Made Tech

At Made Tech we want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user-centric, data-driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision-making for our clients.

As a Senior Data Engineer, your day to day tasks and role may vary according to our clients' needs. The role is very hands-on and you'll support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team.

You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution.

As a member of the Data and AI Practice within Made Tech, you will also participate in the continued development of the practice, as well as representing us both internally to the organisation and publicly via presentations. You’ll need to have a drive to deliver outcomes for users and have a desire to share your knowledge and participate in skill transfer sessions.

Skills, Knowledge & Expertise

We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria.

Engineering and Data Engineering:

• Hands-on and knowledge of programming languages particularly Python
• Practical experience with major cloud providers including GCP, Azure, or AWS
• Knowledge of core software engineering concepts like DRY and SOLID
• Proficiency in version control systems, specifically Git or similar tools
• Demonstrated application of TDD and diverse testing methodologies, such as data quality, integration, and unit testing
• Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments
• Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT
• Familiarity with various data architectures, such as Lakes and Warehouses
• Hands-on experience with data cleansing and transformation within unified, standardised schemas

Technologies:

While mastery of every tool is not required, we are seeking Engineers who have experience with one or more of the following technological areas:

• Analytics & Platform Frameworks
• Orchestration like Airflow or AWS Glue
• Database Technologies
• Data processing libraries & Schema Management tools like Pandas and Pydantic
• Storage Formats: Familiarity with data types such as JSON and Parquet

DevOps and DataOps:

• Experience of IaC tools, particularly Terraform
• Understanding of implementing logging, monitoring and alerting for enterprise level pipelines
• Understanding of access controls, policies and approaches

Consultancy Skills:

• Enthusiasm for learning and self-development and sharing that within a team and organisation
• Knowing how to gather basic requirements from clients and users on a data project and turn those into demonstrable outcomes
• Knowledge of how to document and diagram systems being built
• Great communication skills to explain and relate concepts to stakeholders of different levels
• Able to help coordinate with Product and Delivery managers

Support in applying

If you need this job description in another format, or other support in applying, please email [email protected].

We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We’re collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us.

When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates.

Life at Made Tech

We’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from our blog, where we talk about mental health, communities of practice and neurodiversity (as well as our client work and best practice).

Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.

The groups are:

• antiracist-activists
• disability
• lgbtqiaplus-allies-and-activists
• neurodiversity
• parents-carers
• women-in-tech

Benefits

We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below:

✈️ 30 days Holiday - we offer 30 days of paid annual leave

🕰️ Flexible Working Hours - we are flexible with what hours you work

👶 Flexible Parental Leave - we offer flexible parental leave options

👩 💻 Remote Working - we offer part time remote working for all our staff

🤗 Paid counselling - we offer paid counselling as well as financial and legal advice.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility. Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process, it is apparent that you may not be eligible for SC, we won't be able to progress your application.