Senior Data Engineer
Indexed description
Our global team of experts in software development, product design, growth, and analytics collaborates across time zones to deliver category-defining innovations. We work end-to-end across the product lifecycle: design, build, launch, and scale.
If you’re passionate about building transformative products, Progress Partners is a place to make a lasting impact.
About The Role
We're looking for a Senior Data Engineer to build our data platform from scratch, a rare greenfield opportunity to make the foundational architecture calls yourself. You'll design the pipelines that bring together high-volume payment transactions, marketing analytics, and operational data across AWS and GCP into a unified Lakehouse. This is a hands-on, ownership-heavy role.
What You’ll Do
- Design and build ingestion pipelines for high-volume payment data (Stripe, PayPal, Solidgate), marketing analytics (GA4, GTM, Google Ads, Amplitude), and operational databases (MongoDB, PostgreSQL).
- Build the data infrastructure for a Lakehouse using AWS and GCP.
- Build medallion-layer transformation models (Bronze → Silver → Gold) in dbt, with payments and marketing data on BigQuery.
- Own orchestration end-to-end in Airflow, lineage, sensors, backfills, retries, and alerting across the full asset graph.
- Implement infrastructure as code best practices, cost controls etc.
- 3+ years building production data platforms and pipelines from the ground up.
- Deep expertise in Airflow, including lineage, backfill, and retry strategies.
- Hands-on experience with dbt, version-controlled transformations.
- Strong AWS and GCP skills, with Terraform for infrastructure as code and a cost-conscious (FinOps) approach.
- Strong written communication and the ability to work autonomously in a remote, async environment.
- Familiarity with data mesh principles, domain ownership, or data product design.
- Experience with Lakehouse architecture and Starburst Galaxy.
What we offer
- Remote-first: work from anywhere in the world, no relocation required.
- Flexible hours: we measure outcomes, not time at a desk.
- Unlimited PTO: take the time you need to rest, recharge, and do your best work.
- Learning & development budget: courses, books, conferences, certifications, whatever helps you grow.
- Performance-based compensation: your impact directly shapes your pay and career trajectory.
- A small, senior, collaborative team where your work is visible and your decisions matter.
- The chance to build products used by millions of people across 160+ countries.
We hire on skills, experience, potential, and values fit, never on protected characteristics. If you need accommodations during the application or interview process, just let us know.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search