Senior Data Engineer

Who We Are

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

What You’ll Be Doing

As a Senior Data Engineer, you’ll play a key role in advancing our modern cloud data platform (Databricks/AWS). You’ll combine hands-on engineering expertise with technical leadership, helping shape architecture, uplift data capabilities, and support advanced analytics and machine learning use cases.

You’ll work across a collaborative data ecosystem, partnering with data scientists, BI teams, and architects to deliver scalable, high-quality data solutions.

You Will

• Build, maintain and optimise scalable data pipelines for analytics and ML
• Design data solutions and contribute to platform architecture
• Develop real-time and batch data processing frameworks
• Champion best practices across data modelling, quality and governance
• Support and deliver against the data engineering roadmap
• Collaborate with stakeholders to ensure data is accessible and reliable

At Compare the Market and iSelect, we’re all about helping people make smart choices – and joining us might just be yours. We offer an environment where your ideas are heard, your contributions are valued, and your growth genuinely matters. Collaboration is part of our DNA, and you’ll be joining a supportive, forward-thinking team where you can do meaningful work (and be recognised for it!)

We’re guided by three shared values that shape how we work, how we treat each other, and how we show up for our customers – Drive, Noble Intent and All Together.

Plus, we offer a range of great perks to help you thrive both in and out of work:

• Vibrant and social community with events and celebrations
• Flexible work – one day WFH or a 9-day fortnight
• ‘ME’ leave and ‘Volunteer Day’ leave
• Option to purchase additional leave
• Return to Work bonus for parents
• Quarterly Award and Recognition program

We’d love to hear from professionals who have:

• 5+ years’ experience building data pipelines in production environments
• Strong Python and SQL skills for data engineering
• Experience with cloud platforms (AWS) and modern data stacks
• Knowledge of data modelling, governance, security and quality practices
• Experience with CI/CD and Infrastructure as Code
• Ability to provide technical guidance and mentor others

• Databricks, Spark or PySpark experience
• Experience with real-time/streaming data or ML feature stores
• Metadata-driven or highly automated data solutions

At Compare the Market and iSelect we’re proud to be an Equal Opportunity Employer and we embrace diversity.

This role is available to candidates with unlimited Australian working rights only. Sponsorship is not available.

Compare the Market and iSelect are committed to protecting your privacy. All applications and personal information are kept confidential and securely stored in line with Australian privacy laws, used only for recruitment purposes, and not shared with third parties outside the Auto & General Holdings Group without your consent.