AWS Data Lakehouse Engineer

Job description

Role-AWS Data Lakehouse Engineer

Mandatory Skills : AWS Lambda, Data lakehouse Architecture, ETL Concepts

Mode-5 days from Office

Type-Perm/FTE

Location-Basildon, UK

Salary- GBP 70k/Annum

Overview

We are seeking a talented and experienced

to join the Data Solutions domain in EMEA In this role you will design build

Data Lakehouse Engineer

and optimize scalable lakehouse and data platform solutions that enable datadriven decisionmaking across the organization You will collaborate

closely with crossfunctional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and high

quality data across the ecosystem

Key Responsibilities

Contribute to the design and implementation of lakehouse integration architectures including data flows process flows and ELTETL

patterns

Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and lakehouse layers

Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle

Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability

Provide production support ensuring robust system observability with proactive detection and resolution of issues

Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg

IcebergDelta patterns

Technical Qualifications

7 years of experience in a data engineering or similar role within a fastpaced enterprisescale environment

Bachelors or Masters degree in Computer Science Data Engineering or a related technical field

Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data

transformation and orchestration processes

Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies

Apache Iceberg

Proven expertise with Snowflake including performance tuning and efficient query designExperience with batch pipelines eg

StreamSets and streaming technologies eg Kafka

Nice to have

Data Transformation Frameworks such as DBT

Experience with both batch StreamSets and streaming Kafka data solutions

Familiarity with data modelling concepts Inmon Kimball Data Vault etc

Exposure to CICD or Infrastructureascode Terraform or any other is a plus

Application Performance Monitoring Framework experience is a plus

Knowledge of data quality and security best practices is advantageous

Ability to understand complex architecture solutions and make sound estimates for the implementation

NonTechnical Skills

Strong attention to detail with a proactive approach to identifying and resolving problems

A genuine interest in emerging data technologies and a curiosity about continuous improvements

Excellent verbal and written communication skills

Attention to detail mindset proactively identify problems evaluate solutions

Comfort working in an AIempowered automationdriven environment

Skills

Mandatory Skills : AWS Lambda, Data lakehouse Architecture, ETL Concepts

Good to Have Skills : DBT, Snowflake