GCP Data Engineer
Indexed description
Role: GCP Data Engineer
Location: Charlotte, NC
Hybrid
Employment Type: Full-Time
Role Overview
We are seeking a highly skilled Google Cloud Platform (GCP) Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on experience with GCP services, modern data architectures, ETL/ELT processes, and data warehousing technologies to support business intelligence, analytics, and AI/ML initiatives.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on Google Cloud Platform.
- Build and optimize ETL/ELT processes for ingesting data from multiple sources.
- Develop data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Cloud Composer.
- Create and manage enterprise-scale data warehouses and data lakes.
- Implement batch and real-time data processing frameworks.
- Ensure data quality, governance, security, and compliance standards.
- Optimize BigQuery queries and cloud infrastructure for performance and cost efficiency.
- Work closely with Data Analysts, Data Scientists, Business Analysts, and Application Teams.
- Monitor pipeline performance and troubleshoot data-related issues.
- Support CI/CD implementation and automation of data engineering workflows.
- Document technical designs, architecture, and operational procedures.
- Participate in cloud migration and modernization initiatives.
Required Skills
Technical Skills
- Strong experience with Google Cloud Platform (GCP).
- Hands-on expertise with:
- BigQuery
- Dataflow
- Dataproc
- Pub/Sub
- Cloud Storage
- Cloud Composer (Airflow)
- Cloud Functions
- Cloud Run
- Strong SQL programming skills.
- Experience with Python, Java, or Scala.
- Expertise in ETL/ELT development and data integration.
- Knowledge of data modeling techniques (Star Schema, Snowflake Schema).
- Experience with Apache Spark and Hadoop ecosystem.
- Understanding of data warehousing concepts.
- Familiarity with version control tools such as Git.
- Exposure to CI/CD tools and DevOps practices.
Cloud & Data Technologies
- BigQuery
- Looker / Looker Studio
- Dataform
- Terraform
- Kubernetes (GKE)
- Docker
- Apache Airflow
- Kafka (preferred)
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related discipline.
- 4+ years of Data Engineering experience.
- 2+ years of hands-on GCP experience.
- Experience working in Agile/Scrum environments.
- Excellent problem-solving and communication skills.
Preferred Qualifications
- GCP Professional Data Engineer Certification.
- Experience supporting AI/ML workloads.
- Knowledge of Data Governance and Data Quality frameworks.
- Financial Services, Banking, Insurance, or Healthcare domain experience preferred.
- Experience migrating on-premise data platforms to GCP.
Nice to Have
- GenAI/LLM integration experience.
- Vertex AI knowledge.
- MLOps exposure.
- Real-time streaming using Pub/Sub and Dataflow.
- Experience with Informatica, Talend, or other ETL tools.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search