Data Engineer

We are looking for an experienced Data Engineer to join a team focused on building and supporting scalable, cloud-native data platforms.

What you’ll be doing

• Design, develop and support cloud-native data platforms and data pipelines.
• Build and maintain ETL/ELT pipelines using AWS services.
• Work extensively with SQL, Python and Spark/PySpark for data processing and transformation.
• Develop solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
• Apply data modelling and database design principles to support scalable data solutions.
• Work with Change Data Capture (CDC) and operational databases.
• Contribute to data governance, monitoring and CI/CD processes.
• Work with GitHub Actions to support automated deployments and delivery.
• Collaborate with stakeholders and delivery teams in an Agile environment.
• Troubleshoot data pipeline and platform issues and contribute to continuous improvement.

What we’re looking for

• Strong commercial experience as a Data Engineer.
• Hands-on expertise in SQL and Python.
• Strong experience with AWS, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
• Solid experience developing ETL/ELT data pipelines.
• Strong knowledge of data modelling.
• Hands-on experience with Spark/PySpark.
• Experience with CDC, data governance, CI/CD and monitoring.
• Experience working with operational databases.
• Strong problem-solving and stakeholder engagement skills.
• Experience working in Agile delivery environments.

Nice to have

• Kafka / Amazon MSK
• Terraform
• Event-driven architectures
• Snowflake
• dbt

If this sounds like you, apply now or contact Anupama Cavuturi on 0486 199 174 for a confidential discussion.