Lead Data Software Engineer

Lead Data Engineer

Job Description

Our client, a leading organisation, is seeking an experienced Lead Data Engineer to play a key technical leadership role in the design, development and evolution of modern cloud-based data platforms. This is a hands-on architectural position suited to an experienced data engineering professional with deep expertise in Python, AWS and enterprise-scale data solutions.

Job Responsibilities

• Lead the architecture, design and implementation of scalable, secure and high-performing data engineering solutions.
• Design and develop modern cloud-native data platforms using AWS services and Python.
• Provide technical leadership and architectural guidance across data engineering initiatives while remaining hands-on with solution delivery.
• Design robust ETL/ELT pipelines to support large-scale data ingestion, transformation and integration requirements.
• Drive best practices around data architecture, governance, security, scalability and performance optimisation.
• Collaborate with solution architects, software engineers, business stakeholders and product teams to deliver enterprise data solutions.
• Evaluate emerging technologies and recommend improvements to existing data engineering frameworks and platforms.
• Mentor and support engineering teams through technical leadership, code reviews and architectural direction without direct people management responsibilities.
• Ensure solutions are resilient, maintainable and aligned with enterprise architecture standards.

Experience Required

• Minimum of 10 years' experience in Data Engineering, Data Platform Engineering or a closely related technical discipline.
• Extensive hands-on experience designing and building enterprise-scale data platforms.
• Strong expertise developing solutions using Python.
• Extensive experience delivering cloud-native data solutions within AWS environments.
• Proven experience designing modern data architectures and implementing scalable data pipelines.
• Strong understanding of data modelling, data warehousing and distributed data processing concepts.
• Experience working with large, complex datasets in enterprise environments.
• Excellent stakeholder engagement skills with the ability to communicate technical concepts to both technical and non-technical audiences.
• Strong analytical and problem-solving abilities with a focus on delivering high-quality technical solutions.

Desirable Skills

• Experience with AWS services such as Glue, Lambda, EMR, Redshift, S3, Athena and Step Functions.
• Experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
• Knowledge of modern orchestration frameworks including Apache Airflow or similar.
• Experience working with containerisation technologies such as Docker and Kubernetes.
• Exposure to streaming technologies including Kafka or Kinesis.
• Understanding of CI/CD pipelines and DevOps practices.
• Experience working within Agile delivery environments.
• Knowledge of data governance, security and regulatory best practices.

Educational Requirements

• Bachelor's degree or higher in Computer Science, Software Engineering, Information Technology or a related discipline.
• Relevant cloud or data engineering certifications (such as AWS Certified Solutions Architect, AWS Certified Data Engineer or equivalent) would be advantageous.

Working Hours & Benefits

• Hybrid working model based in Dublin 2.
• Competitive salary package (Circa 120k base salary plus bonus and strong benefits).
• Performance-related bonus.
• Pension contribution.
• Healthcare package.
• Life assurance.
• Professional training and certification support.
• Career progression opportunities within a growing technology team.

HOW TO APPLY

If you are interested in this role, please apply with your updated CV