Full Stack Data Engineer
Indexed description
We are seeking a highly skilled Full Stack Data Engineer to drive the development and maintenance of our Enterprise Data Platform. You will design, build, and optimize scalable data pipelines in Google Cloud Platform (GCP), leveraging native technologies like BigQuery, Dataflow, and Pub/Sub
Key Responsibilities
- Data Pipeline Architect & Builder Design, develop, and maintain scalable ingestion pipelines using Python, SQL, DBT/Dataform. Ensure data quality and standardization.
- End-to-End Integration Expert Deliver seamless data flow from source to insight with full-stack integration skills.
- GCP Data Solutions Leader Build and manage platforms using BigQuery, Dataflow, Pub/Sub, Cloud Functions.
- Data Governance & Security Champion Implement governance policies, encryption, masking, and access controls with GCP-native features.
- Workflow Orchestrator Use Astronomer and Terraform for workflow management and Infrastructure as Code (IaC).
- Performance Optimization Driver Monitor and improve pipeline scalability, efficiency, and cost-effectiveness.
- Collaborative Innovator Partner with architects and cross-functional teams to define best practices.
- Automation & Reliability Advocate Automate processes to enhance reliability and minimize manual intervention.
- Effective Communicator Translate technical decisions for both technical and non-technical stakeholders.
- Continuous Learner Stay updated on industry trends and emerging technologies.
- Business Impact Translator Align data solutions with business goals.
- Documentation & Knowledge Sharer Create comprehensive documentation to support collaboration and maintainability.
Qualifications
- Bachelor’s degree in Computer Science, IT, Data Analytics, or related field.
- 5–7 years in Data/Software Engineering, with 2+ years in cloud-based platforms (GCP preferred).
- Strong proficiency in SQL, Java, Python.
- Hands-on experience with BigQuery, DataForm, Dataflow, DataProc.
- Knowledge of SOA, microservices, relational & NoSQL databases.
- Expertise in data governance, encryption, masking.
- Experience with unstructured data manipulation and AI-ready data products.
- Familiarity with CI/CD pipelines, Terraform, Tekton.
- Strong analytical and troubleshooting skills.
- Proven ability to optimize cost and compute resources in GCP.
- Passion for data, innovation, and continuous learning.
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search