Lead II - Data Engineering
Indexed description
At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.
Summary
UST is looking for a opening for big data developer
- 7-10 years of professional experience in data engineering.
- Minimum 4 years building and operating production data pipelines on AWS.
- Strong programming ability in Python or Scala, with production-quality code standards.
- Expert-level SQL, including window functions, CTEs, and query plan analysis.
- Deep, hands-on Apache Spark experience — not just usage, but performance tuning and debugging.
- Demonstrated ability to diagnose Spark data skew, shuffle bottlenecks, and memory issues.
- Production experience across the AWS data stack: EMR, S3, Athena, Redshift, and Lambda.
- Streaming data experience with Amazon Kinesis or Apache Kafka.
- Workflow orchestration with Apache Airflow (MWAA) or an equivalent scheduler.
- Solid data modelling fundamentals, including dimensional modelling and slowly changing dimensions.
- Working knowledge of data lake table formats such as Apache Iceberg, Hudi, or Delta Lake.
- Experience operating what you build — CloudWatch, structured logging, ing, and on-call participation.
- Familiarity with version control and collaborative development workflows using Git.
- Ability to work directly with non-technical stakeholders and communicate trade-offs clearly
Humility
We will listen, learn, be empathetic and help selflessly in our interactions with everyone.
Humanity
Through business, we will better the lives of those less fortunate than ourselves.
Integrity
We honour our commitments and act with responsibility in all our relationships.
Equal Employment Opportunity Statement
UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.
All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.
- To support and promote the values of UST.
- Comply with all Company policies and procedures
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search