Data Engineer

About the Role

We are seeking an experienced Data Engineer to design, build, and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data.

The ideal candidate will have strong hands-on experience with SQL and Python, modern cloud data platforms, and Lakehouse/Medallion architectures. This is a hands-on engineering role focused on building reliable data pipelines, processing large datasets, and developing scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable cloud data pipelines for high-volume data.
• Build batch and real-time data processing solutions using Spark/PySpark, Kafka, and Airflow.
• Develop data ingestion, transformation, and integration workflows using SQL and Python.
• Design and implement Lakehouse and Medallion architecture solutions.
• Work with cloud data platforms including Databricks, Snowflake, AWS, and/or Azure.
• Build and optimize ETL/ELT pipelines for performance, scalability, and reliability.
• Process and integrate large volumes of manufacturing, operational, and IoT data.
• Troubleshoot data pipeline issues and improve data quality and performance.
• Collaborate with engineering, analytics, and business teams to develop production-ready data solutions.

Qualifications

• 5+ years of professional Data Engineering experience; additional experience is welcome for the right candidate.
• Strong proficiency in SQL and Python.
• Hands-on experience building scalable data pipelines.
• Experience with Lakehouse and/or Medallion architectures.
• Experience with Databricks, Snowflake, AWS, and/or Azure.
• Strong experience with Apache Spark and/or PySpark.
• Experience with Apache Kafka and/or other streaming technologies.
• Experience with Apache Airflow or other data orchestration tools.
• Experience working with Delta Lake or similar data lake technologies.
• Strong understanding of ETL/ELT, data integration, and data transformation.

Benefits

Full-time employees receive a benefits package, including:

• Medical, dental, and vision coverage
• 100% company contribution toward employee medical coverage
• 80% company contribution toward medical coverage for immediate dependents
• 15 days of PTO
• 10 paid holidays, including 8 fixed holidays and 2 floating holidays
• 401(k) enrollment with employee contributions
• Relocation assistance
  

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.