GCP Data Engineer

GCP Data Engineer with AI

Core Skills & Technologies:

Python (strong OOP practices, modular and reusable components)

Google Cloud Platform (GCP): BigQuery, Cloud Storage, Cloud Functions, Cloud Run

ETL/ELT & Data Pipelines: Cloud Dataflow, Cloud Composer (Airflow), Pub/Sub

Streaming & Real‑Time Systems: event‑driven architectures

Data Warehousing & Modeling: schema design, performance optimization (partitioning, clustering, materialized views)

Containers & Platforms: Docker, Kubernetes

APIs & Integrations: REST APIs, Swagger/OpenAPI, external system ingestion (APIs, flat files)

CI/CD & DevOps: Git, Cloud Build, GitHub Actions, Jenkins

Observability: Cloud Monitoring, Cloud Logging, Error Reporting

Security & Compliance: IAM, access controls, data governance; CVE remediation with a focus on automation

Big Data & Cloud Architecture (GCP preferred; AWS/Azure acceptable)

AI / ML‑enabled services (Gemini and Vertex AI)

Jira, SAFe / Agile delivery practices

Experience with GitHub Copilot / AI‑assisted development is a plus

Familiarity with integration and functional testing preferred.

Consider below instructions while sourcing the profile.

This is primarily a GCP Data Engineer / Python Engineer role with strong experience in building data pipelines, cloud-based applications, and AI-enabled solutions.

Must-Have Skills

✅ Strong Python programming (OOP concepts, reusable code, clean coding practices)

✅ Google Cloud Platform (GCP)

• BigQuery
• Cloud Storage
• Cloud Functions
• Cloud Run

✅ Data Engineering

• ETL/ELT pipelines
• Dataflow
• Airflow (Cloud Composer)
• Pub/Sub

✅ Real-Time Data Processing

• Event-driven architecture
• Streaming data pipelines

✅ BigQuery/Data Warehouse

• Schema design
• Partitioning
• Clustering
• Performance optimization

✅ Docker & Kubernetes

✅ REST APIs & integrations

✅ CI/CD

• Git
• GitHub Actions
• Jenkins
• Cloud Build

✅ Monitoring & Logging

• Cloud Monitoring
• Cloud Logging

✅ Security

• IAM roles
• Access management
• Data governance
• CVE remediation

Preferred Skills

⭐ Vertex AI / Gemini

⭐ GitHub Copilot

⭐ Integration & Functional Testing

⭐ Agile / SAFe