AWS Data engineer

Minimum years of experience: 8 to 10 years

Job Description:

Key Responsibilities

Data Engineering & Platform Development

- Design, develop, and maintain scalable, secure, and high-performance data pipelines on AWS.

- Build and manage enterprise data lake solutions using Amazon S3 and AWS Lake Formation.

- Develop and support ETL/ELT workflows using AWS Glue, Python, and SQL.

- Design and implement serverless data processing solutions using AWS Lambda.

- Orchestrate and automate data workflows using AWS Step Functions.

Data Warehousing & Analytics

- Design, develop, and optimize data warehouse solutions using Amazon Redshift.

- Enable data analytics and reporting through Amazon Athena.

- Ensure data quality, integrity, and availability across the data platform.

Cloud Infrastructure & Security

- Configure and manage AWS services including IAM, VPCs, Subnets, SNS, and SQS.

- Develop Infrastructure as Code (IaC) using AWS CloudFormation.

Core Skills & Competencies

AWS: S3, IAM, Lambda, Glue, Step Functions, Lake Formation, VPC & Subnets, Athena, Redshift, Service Catalog, CloudFormation, SNS, SQS

Programming: SQL, Python, ETL/ELT

Development: Unix/Linux, Shell Scripting, Git

Qualifications & Experience

- Bachelor's or Master's degree in a related field.

- 8+ years of experience of overall experience and 6+ years of experience as AWS Data Engineer

Preferred Experience (Nice to Have)

GitLap

Nexus Repository Manager

Redshift Performance Optimization

Snowflake

DBT (Data Build Tool)