Back to search
VLink Inc Linkedin · Posted 8d ago

Data Engineer

Tangerang

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Key Responsibilities

  • Engineered end-to-end ETL pipelines ingesting data from diverse on-premise sources (MySQL, Oracle, SQL Server, and SAP DB) into a multi-layer BigQuery data warehouse and an S3-based lakehouse; implemented Medallion architecture and Slowly Changing Dimensions (SCD) with Open Table Formats to optimize analytical performance.
  • Orchestrated and automated large-scale, cross-cloud data workflows by designing and managing 20+ Airflow DAGs with SLA monitoring and automating complex ETL using Python/Java with GCP tools (Dataproc, Dataflow).
  • Led cloud migration initiatives by successfully moving 200+ tables from GCP to AWS, utilizing AWS Glue, Lake Formation, and MWAA, significantly optimizing metadata governance and performance.
  • Implemented a robust CI/CD pipeline using Azure DevOps to automate the deployment and management of all data assets, including AWS Glue jobs, Athena queries, Redshift, and Airflow DAGs.


Requirement

  • Minimum 3 year of experience as Data Engineer
  • Knowledge of programming languages: Java, Python, Bash Script
  • Hands on experience with SQL
  • Familiar with some of big data stacks like Hadoop, Google Cloud Bigquery, Google Cloud, Dataflow, Apache Airflow, Kafka, NoSQL database
Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search