Senior Assoc/Assoc, Cloud Engineer, Data Platform, Group Technology
Indexed description
Job Responsibilities
As a Cloud Engineer, you'll be an Engineering Specialist and help us discover the information hidden in vast amounts of data. You'll be part of the team which builds a hybrid cloud data platform that runs heavy computation jobs in the cloud as well as supports data scientist in their AI/ML modelling journey.
- Design and implement key components for highly scalable, distributed data collection and analysis system built for handling petabytes of data in the cloud.
- Work with architects of the analytics system and help in adopting best practices in backend infrastructure and distributed computing, that supports Machine Learning and Agentic workloads.
- Implement core practice of Agile, leveraging cloud-native architecture patterns and using Test Driven Development, continuous integration/continuous delivery
- Continuously discover, evaluate and implement new cloud technologies to maximize analytical system performance
- Hands-on experience with Google Cloud Platform (GCP), including deploying and managing infrastructure and data services
- Enterprise experience building complex solutions within GCP and experience with architecting GCP production workloads for Business and IT operations, across a hybrid cloud environment.
- Proficiency with infrastructure-as-code tools like Terraform to automate provisioning, configuration management, and orchestration within GCP
- Hands-on experience with containers and containers orchestrators (Kubernetes, Docker), as well as serverless architectures within GCP
- Hands-on experience with Dataproc, BigQuery
- Experience with Spark and different schema formats (Avro, Parquet)
- Understanding of infrastructure monitoring, log analysis, and automation for incident response within GCP
- Ability to instrument, validate, and automate security controls within GCP
- Demonstrable strong cloud architecture or development experience, specifically Google Cloud Platform (GCP) with associate or specialist level certification.
- Manage and resolve Operational issues as the L2/L3
- Development experience in Java/Python and pride in producing clean, maintainable code.
- Experience using high-throughput, distributed message queueing systems such as Kafka.
- Familiarity with tracing/observability solutions, e.g. OpenTelemetry
- Mastery of key development tools such as GIT, and familiarity with collaboration tools such as Jira and Confluence or similar tools.
- Experience with SQL engines (e.g. MySQL, PostgreSQL)
- The ability to work with loosely defined requirements, and exercise your analytical skills to clarify questions, share your approach and build/test elegant solutions in weekly sprint/release cycles.
Job:
Technology
Schedule:
Regular
Employee Status:
Full time
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search