Senior Data Engineer
Indexed description
- PostgreSQL/MPP Platform Performance & Operations
- Airflow Pipelines — Design, develop, deploy, monitor, and troubleshoot complex data pipelines using Apache Airflow to process, transform, and load large-scale datasets efficiently and reliably.
- Build, maintain, and continuously improve data systems supporting scientific research, including relational databases and cloud-based Lakehouse
- Ensure data accuracy, accessibility, observability, and reliability through proactive monitoring, alerting, and incident response
- Work with scientists, data engineers, and cross-functional teams to translate requirements into robust, scalable platform solutions.
- Advanced expertise in PostgreSQL and Greenplum MPP
- Strong proficiency with Apache Airflow
- Hands-on experience with AWS cloud services
- Strong Python programming skills and proficiency in SQL and SQL performance tuning
- Strong experience designing, building, and optimizing data pipelines at scale
- Bachelor’s or master’s degree in computer science, Information Technology, or a related discipline
- 8+ years of experience as a data engineer with proven expertise in Python, PostgreSQL, Airflow, AWS services, and production-grade practices
- Specialized technologies such as Trino for distributed querying, Apache Iceberg for lakehouse management, Greenplum or other MPP systems, and large-scale performance tuning
- Tackling complex challenges with high-volume scientific data, query optimization, and modern data infrastructure
Employer retirement contribution – direct STScI contribution of 10% of your salary from your first day
12 days sick leave, up to 24 days’ vacation, and 10 paid holidays
Flexible work schedule with healthy work/life balance
Comprehensive medical/dental/vision/prescription plans, and more!
Salary range is $125,000 - $150,000. Final compensation is based on experience, skills, internal equity, and market conditions.
Application link - Senior Data Engineer
Applications received by 06/27/2026 will receive full consideration. Applications received after this date will be considered until the position is filled. Reference #:0015514
Individuals needing assistance with the employment process can contact us at [email protected].
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search