Lead Data Engineer

Key Skills: Snowflake, Azure Databricks, DBT, Python, SQL, Terraform, CI/CD, Data Architecture, Distributed Systems, Data Migration

Experience: 8+ years of experience (including 2–3 years in Lead or Staff roles)

Location: LATAM (open to all countries in the region)

Work Model: Remote for legal residents in LATAM

At Coforge, we are looking for a Lead Data Engineer (#22145) with the following profile.

Main Responsibilities

• Lead and mentor a team of data engineers, defining technical direction and promoting engineering excellence
• Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs
• Take full ownership of delivery from design to deployment, ensuring high-quality production-ready solutions
• Define and drive data migration strategy from Snowflake / SSIS to Azure Databricks and DBT
• Collaborate with cross-functional teams (data, product, architecture, business) to translate requirements into robust technical solutions
• Design and oversee scalable data pipelines and data models with a focus on performance and maintainability
• Lead infrastructure-as-code implementation using Terraform, ensuring automation and consistency
• Establish and enforce architecture standards, design patterns, and best practices across the data ecosystem
• Ensure reliable data integration between legacy systems and Azure environments, focusing on data quality and observability
• Drive CI/CD adoption and oversee release processes for pipelines and platform components
• Act as the primary technical owner for troubleshooting complex issues and ensuring platform stability
• Maintain comprehensive documentation of architecture, design decisions, and implementation standards

• 8+ years of experience in Data Engineering, including 2–3 years in a Lead or Staff role
• Proven experience designing and implementing large-scale data platforms
• Strong hands-on expertise with Snowflake, Azure Databricks, DBT, and Python
• Experience handling large-scale data transformations (thousands of DBT models and pipelines processing terabytes of data daily)
• Deep understanding of data architecture, data modeling, and distributed systems
• Extensive experience with Terraform and Infrastructure-as-Code principles
• Proven experience leading cloud-to-cloud migrations (AWS to Azure preferred)
• Strong experience with CI/CD pipelines and Git-based version control
• Advanced SQL skills and strong knowledge of ETL/ELT frameworks
• Strong problem-solving skills with the ability to make architectural decisions and trade-offs
• Excellent communication skills with the ability to influence technical and non-technical stakeholders
• Ability to thrive in a fast-paced, ownership-driven environment
• Industry experience in insurance or financial services, with knowledge of domains such as claims, policies, underwriting, and risk
• Proven experience managing teams, including mentoring, coaching, and developing talent across performance levels

• Experience implementing data governance, observability, and data quality frameworks
• Knowledge of security and compliance standards in financial or insurance environments
• Experience with real-time and streaming technologies (Kafka, Event Hubs, Delta Live Tables)
• Familiarity with lakehouse architecture and cost/performance optimization strategies

At Coforge, we hire professionals based solely on their skills and qualifications, without discrimination based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.