Data Engineer

We are seeking an experienced Senior Data Engineer & Data Platform Lead to play a key role in designing, building, and scaling a modern enterprise data platform leveraging Databricks and Microsoft Fabric.

This role combines hands-on engineering, dimensional data modelling, and technical leadership. You will work closely with business stakeholders, analysts, architects, and engineering teams to deliver scalable, high-quality data products that support reporting, analytics, and self-service BI across a retail and POS environment.

The ideal candidate is equally comfortable defining data architecture, developing complex pipelines, optimizing platform performance, and mentoring engineering teams.

Key Responsibilities:

Data Platform Leadership

• Provide technical leadership and best-practice guidance for enterprise data platform design and implementation.
• Own and evolve data architecture across Databricks and Microsoft Fabric.
• Drive technical standards for data engineering, modelling, governance, documentation, and operational excellence.
• Partner with business stakeholders to translate business objectives into scalable data solutions.

Data Engineering & Integration

• Design, build, and maintain robust data pipelines supporting batch, incremental, CDC, and streaming workloads.
• Integrate data from POS, ERP, APIs, cloud platforms, and other enterprise systems.
• Implement scalable ingestion, transformation, and distribution frameworks.
• Optimize workflows for reliability, performance, and cost efficiency.

Data Modelling & Analytics Enablement

• Design and maintain dimensional data models, including star and snowflake schemas.
• Develop reusable data products that support reporting, analytics, and self-service BI.
• Ensure data structures align with business processes and analytical requirements.

Data Quality, Performance & Governance

• Establish data quality frameworks, automated testing, lineage, and monitoring capabilities.
• Optimize SQL workloads, Spark jobs, and platform performance.
• Drive metadata management, documentation, and governance practices.
• Support DevOps, CI/CD, and release management processes.

Team Collaboration & Mentorship

• Mentor engineers and promote engineering best practices.
• Contribute to knowledge sharing and continuous improvement initiatives.
• Collaborate effectively with business analysts, BI developers, solution architects, and platform teams.

Required Experience:

• 7+ years of experience in Data Engineering, Data Platform Development, or related disciplines.
• Proven experience designing and implementing enterprise-scale data solutions.
• Strong experience building modern data platforms and analytics ecosystems.
• Experience working within retail, POS, or consumer-facing business environments is highly desirable.