Data Engineer

Job Overview

We are looking for an experienced GCP Data Lead Engineer with 5–8 years of hands-on experience in Google Cloud Platform data engineering to support a large-scale legacy-to-GCP migration program. The successful candidate will lead the migration team in designing, implementing, and validating scalable GCP data solutions using BigQuery, Dataproc, and Cloud Composer.

Key Responsibilities

Act as the Subject Matter Expert (SME) for GCP data engineering technologies and best practices.

Design, develop, and optimize data pipelines using Dataproc (Spark/Hadoop), Cloud Composer (Airflow), and BigQuery.

Lead migration of legacy ETL and data warehouse workloads to Google Cloud Platform.

Design orchestration workflows, job scheduling, dependency management, and pipeline automation.

Build and maintain Dataproc pipelines for data transformation while ensuring business logic consistency.

Collaborate with migration teams to troubleshoot and validate migrated data pipelines.

Optimize BigQuery performance through partitioning, clustering, and efficient query design.

Improve Dataproc cluster performance and cost optimization.

Required Skills

Fluent in German and English (Mandatory)

5–8 years of hands-on GCP Data Engineering experience

Strong expertise in:

Google BigQuery

Google Dataproc (Spark/Hadoop)

Cloud Composer (Apache Airflow)

Google Cloud Storage (GCS)

Strong Python and/or PySpark programming skills

Expertise in Airflow DAG development, scheduling, and dependency management

Strong SQL and data modeling experience

Preferred Skills

Experience in legacy-to-cloud migration projects

Knowledge of Ab Initio or legacy ETL platforms

Experience with CI/CD tools such as:

Cloud Build

Terraform

Knowledge of UC4 job scheduling

Experience with Oracle and SQL Server databases