Sr Engineer Data Engineering
Indexed description
Team Overview
We are seeking a highly experienced and motivated Lead Data Analyst with a strong background in SQL and Spark SQL, Unix shell scripting, supporting ETL setup, Big Data technologies, and AI to lead and mentor a team. You will be responsible for delivery of data. This role requires a deep understanding of data processing, data warehousing, and machine learning principles, along with hands-on experience in cloud environments like AWS and GCP usage. You will be a technical leader, driving best practices, providing mentorship, and ensuring the successful delivery of high-quality, scalable, and maintainable solutions. This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
Role Overview And Core Responsibilities
- Architect and oversee SQL/Spark SQL, Unix commands and data operations-based data analysis solutions.
- Lead ETL strategy and ensure robust data pipelines.
- Utilize Linux commands for system operations, troubleshooting, and deployment tasks.
- Work within cloud environments (AWS, GCP) to manage infrastructure, data workflows, and deployments.
- Partner with business leaders to define KPIs and analytical frameworks.
- Drive data governance and quality initiatives.
- Ensure data accuracy and consistency across systems.
- Lead and mentor a team of delivery.
- Analyze Java logs to identify and try to resolve performance bottlenecks and application issues.
- 9+ years of experience in data analysis with deep SQL/Spark SQL and unix and expertise.
- Proven experience in ETL setup and data pipeline management.
- Strong stakeholder management and leadership skills.
- Experience in strategic analytics and decision support.
- Experience with specific industries (e.g., e-commerce, finance, healthcare).
- Contributions to open-source projects.
- Certifications in AWS or GCP.
- Bachelors / Master's degree in Computer Science or a related field.
Be a part of our Workforce for Good – you’ll work with great people, pioneering products and cutting-edge technology.
TransUnion Job Title
Sr Engineer, Database Engineering
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search