UST
Linkedin · Posted 5d ago
Lead I - Data Engineering
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Role Description
- Strong expertise in SQL for complex query development, data extraction, transformation, analysis, and performance optimization.
- Proficient in Python programming for data processing, automation, data cleansing, transformation, and aggregation tasks.
- Hands-on experience with Microsoft Azure, including Azure Data Factory (ADF) and Azure Databricks for building scalable data solutions.
- Experience developing and managing ETL/ELT pipelines to integrate data from databases, APIs, and other structured and unstructured sources.
- Strong knowledge of Databricks and Apache Spark for large-scale data processing, engineering workflows, and notebook-based development.
- Skilled in ensuring data quality, integrity, and governance, including troubleshooting and resolving data-related issues across enterprise platforms.
- Proven ability to collaborate with business stakeholders, analysts, and data scientists to deliver data-driven solutions while maintaining and optimizing existing pipelines and reporting platforms.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search