GCP Data Engineer
Indexed description
Key Responsibilities
- Design, develop, and maintain scalable and robust data pipelines on GCP
- Build and optimize data warehouses using BigQuery (partitioning, clustering, query tuning)
- Develop ETL/ELT pipelines using Python and GCP-native tools
- Integrate data from multiple sources including APIs, databases, and streaming platforms
- Ensure high performance and cost efficiency of data processing systems
- Collaborate with data analysts, data scientists, and business stakeholders
- Implement data quality checks, governance, and security standards
- Monitor, debug, and optimize data workflows and pipelines
- Support batch and real-time data processing requirements
- 5+ years of hands-on experience in Data Engineering
- Strong experience with Google Cloud Platform (GCP)
- Expertise in BigQuery (data modeling, performance tuning)
- Strong programming skills in Python (Pandas; PySpark is a plus)
- Experience with Cloud Composer / Apache Airflow
- Knowledge of Cloud Storage, Pub/Sub, Dataflow
- Advanced SQL and strong data warehousing concepts
- Experience building scalable ETL/ELT pipelines
- Experience with Apache Spark / Databricks
- Familiarity with CI/CD pipelines and DevOps practices
- Knowledge of data visualization tools like Tableau / Looker
- Experience with streaming data processing
- Exposure to data lake / lakehouse architectures
- Bachelor’s or Master’s degree in Computer Science, IT, or related field
- GCP Certification (e.g., Professional Data Engineer)
- Experience working in Agile/Scrum environments
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search