Senior Data Engineer

My client is looking for a seasoned Data Engineer to join the Project team and play a key role in enhancing and maintaining a modern data platform that supports diverse business models.

Responsibilities

• Provide strong hands‑on expertise in building and maintaining scalable ETL pipelines for structured and unstructured data, ensuring reliability and data quality.
• Build and optimize CI/CD pipelines for ETL workflows, data assets, cloud infrastructure, and web applications to integrate with ERP systems and accelerate adoption of AI technologies.
• Identify and implement enhancements to improve cost efficiency and developer experience, including cloud usage analysis and cost management.
• Work with cross‑functional teams—data scientists, engineers, analysts, project managers, and business stakeholders—to deliver solutions aligned with business goals.
• Share expertise in cloud engineering, DevOps, and data platform administration to ensure successful delivery and compliance with best practices (e.g., secure by design).
• Apply AI tools to boost development and delivery productivity.
• Collaborate with vendors and service providers on solution planning, service delivery, and technical support; provide BAU support for IT systems.
• Track and visualize KPIs to monitor platform performance.
• Strengthen data governance and quality management practices across the analytics platform.
• Handle ad hoc tasks as assigned by the supervisor.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, or related discipline.
• 8-10 years of hands‑on experience in data analytics, engineering, platform engineering, DevOps, or related fields.
• Candidates with less experience may be considered for a Data Engineer role.
• Proven expertise in cloud data analytics, preferably Azure Databricks with PySpark, including platform operations, Unity Catalog governance, and integrations across cloud services.
• Proficiency in Jira, Git, and Azure DevOps; containerization experience (Kubernetes, Helm, Istio) is an advantage.
• Hands‑on experience with Python, SQL, shell scripting, and Terraform.
• Exposure to Oracle ERP solutions, web application development (Vue, Spring Boot, FastAPI) is a plus.
• AI Tools: Experience using AI tools (e.g., GitHub Copilot, Claude Code, OpenCode, Codex) to uplift team productivity.
• Strong teamwork, ownership, problem‑solving, and time management abilities.
• Excellent communication skills to explain technical concepts to stakeholders of varying backgrounds.