Senior Data Engineer
Indexed description
- Design and maintain DBT models that produce trusted datasets, features, and metrics the Data Science team relies on for analysis, experimentation, ML, and reporting.
- Build and operate pipelines in Databricks - PySpark jobs and Delta/Iceberg tables - that turn raw operational events into analysis-ready data.
- Develop deep familiarity with operations so the datasets, schemas, and models
- Orchestrate end-to-end data workflows in Airflow (and Prefect where it fits), with SLAs the DS team can count on for daily models, dashboards, and operational decisions.
- Participate in peer code reviews and raise the bar on data quality, testing, and
- Partner with data scientists to scope, design, and productionize feature pipelines and the model-supporting data behind them.
- Optimize DBT and Spark workloads for cost, performance, and reliability as data
- Learning new technologies quickly - nobody comes into this role knowing every piece of the stack.
- 5+ years of experience building, testing, and deploying data engineering systems.
- Experience with at least one distributed data system, and the ability to reason about consistency, latency, throughput, and fault tolerance.
- Strong SQL and proficiency with at least one of (py)Spark, DBT, or Airflow in production.
- Experience with Infrastructure-as-Code systems such as Terraform, AWS CDK, or
- Understanding or strong interest in supply chain and the data challenges it creates.
- A self-starter who takes initiative, moves fast, and ships while collaborating on big
- Enthusiastic about working closely with team members to develop creative solutions to
- Excellent written and oral communication in English.
- Tech: DBT, Databricks, (py)Spark, Airflow, Prefect, SQL, Iceberg/Delta; familiarity
- A plus: Demonstrated, measurable success building with LLMs, evaluating model
Skills: databricks,pyspark,aws,sql,airflow,dbt
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search