Back to search
DFI Retail Group Linkedin · Posted 3d ago

Data Ops Engineer Manager

Petaling

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Is this your next challenge as a Data Ops Engineer Manager?


Works with DFI CoE (data platform), DS team, DFI Monitoring team, DFIT SRE COE, Google Cloud support Location / model: Hybrid, business-hours coverage with on-call participation for P1/P2 data incidents. The Data Operations Manager owns the operational health of the data platform on Google Cloud: observability, CI/CD automation, incident response, and platform administration across the datalake project estate, with the centralized operations project as the control plane. This is a hands-on lead role. The holder is accountable for keeping data pipelines running and observable, for the automation that deploys them, and for the access and ticketing processes that surround them. They act as the L3 escalation point for data platform incidents and as the interface to the platform CoE and Google Cloud support.


The challenge is to:


Centralized observability:


  • Own the centralized logging design: maintain log sinks created in each source project. Own metrics aggregation via the Cloud Monitoring metrics scope: keep the scoping project configuration current as business projects.
  • Build and maintain monitoring dashboards and alert policies in Cloud Monitoring or Grafana, covering both Data Engineering DAG health and underlying GCP infrastructure.
  • Manage alert routing and notification channels; review alert quality regularly and drive down false positives and unactioned alerts. Onboard new projects into the logging and monitoring standard as part of project intake.


CI/CD Automation


  • Own the data ops CI/CD service and its deployment templates.
  • Onboard new projects and repositories onto the CD automation; own the standard folder structure template and enforce its use. Maintain build and deployment reliability: pipeline runtime, failure rate, and diagnosability of failed builds.
  • Drive continuous improvement of the pipeline: build caching, container image hygiene, secret handling, environment promotion, and rollback paths.


Day-to-Day Troubleshooting and Incident Management


  • Act as escalation owner for the standard triage path: Alert → Logging → Data system → GCP infra layer → root cause → recovery runbook.
  • Cover the GCP infrastructure scope for Data Engineering: Cloud Composer, Cloud Functions, Dataproc, BigQuery, Cloud Storage, and the CI/CD tooling.
  • Maintain and extend the GCP Infra Troubleshooting Runbook; ensure every recurring incident results in either a runbook entry or an automation fix.
  • Own the L1/L2 → L3 escalation process, including raising and driving Google Cloud support tickets to closure where internal capability is insufficient.


GCP Platform Operations


  • Provision and operate Dataform repositories, including Bitbucket-backed repository setup.
  • Coordinate with the DFI CoE / data platform team on Composer and shared platform services; escalate platform-level changes through the correct owner.


Leadership


  • Lead and mentor the data operations engineers; set operational standards and review quality of work.
  • Own the operational knowledge base — no single-person dependency on runbooks, dashboards, or pipeline internals.


Do you have experience in?


  • Bachelor’s or master’s degree in Computer Science, Engineering, or related fields.
  • 7+ years in cloud infrastructure, SRE, DevOps or data platform operations, including 2+ years leading a team or an operational function.
  • Strong Python for operational tooling and pipeline code; building CI/CD engineering and deep understanding Infrastructure as code.
  • Demonstrated ownership of a production data platform on Google Cloud.
  • Experience in Google Cloud data components, Cloud Composer / Airflow, BigQuery, Dataproc, Cloud Functions / Cloud Run, Cloud Storage.
  • Experience in Google Cloud operation components, Cloud Logging and Cloud Monitoring — log sinks, log buckets, log scopes, metrics scope, log-based metrics, alert policies.
  • Incident management and escalation in an ITIL-style L1/L2/L3 model.
  • Vendor support engagement — able to construct a support case that gets a fast, correct answer from Google Cloud.
  • Preferred
  • Google Cloud Professional Cloud DevOps Engineer or Professional Data Engineer certification.
  • SRE related experiences.


If you have the right skills and experience, this is an opportunity to build your career with Asia’s leading retailer.


DFI Retail Group is an equal opportunity employer and responsible for ensuring that all personal information collected from each Candidate presented to DFI Retail Group is used for recruitment purposes only and the personaldata will be kept and handled confidentially. We will retain the applications of candidates not selected for a period of no more than 24 months. The data collection process is in accordance with all applicable laws and compliantwith the Code of Practice on Human Resource Management.


To find out more about Our Businesses and Our People, please visit our

website: https://www.DFIretailgroup.com


Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search