Lead Data Engineer with Insurance

Data Engineering Lead

Manager Software Engineering

Location: On-site Charleston ,SC

The Data Engineering Lead is responsible for the design, development, governance, and operational excellence of enterprise data platforms, pipelines, and analytics capabilities. This role provides technical leadership for data engineering initiatives while managing a team of engineers responsible for delivering scalable, secure, and reliable data solutions that support business intelligence, AI, machine learning, operational reporting, and digital transformation programs.

The successful candidate combines deep technical expertise with leadership skills to establish enterprise data standards, drive modernization initiatives, implement cloud-native data architectures, and ensure data is treated as a strategic business asset. This individual will partner closely with product management, application engineering, cloud operations, architecture, security, and business leaders to deliver measurable business outcomes.

Required Qualifications

Education

• Bachelor’s degree in computer science, Information Systems, Engineering, Data Science, or related field.
• Master's degree preferred.

Experience

• 10+ years of experience in Data Engineering, Data Architecture, or related technology disciplines.
• 3+ years leading technical teams or enterprise-scale data initiatives.
• Demonstrated experience designing and delivering enterprise data platforms.
• Experience leading cross-functional teams in global delivery environments.

Technical Expertise

Strong experience in multiple areas including:

• SQL and advanced database technologies
• Python, Spark, Scala, or similar data engineering technologies
• ETL and ELT frameworks
• Data Lakes, Lakehouse, and Data Warehouse architectures
• Cloud platforms (Azure, AWS, or Google Cloud)
• Databricks, Snowflake, Synapse, Redshift, Big Query, or equivalent technologies
• Real-time data processing and streaming architectures
• API-based integration and event-driven architectures
• CI/CD, DataOps, Infrastructure-as-Code, and automation practices

Preferred Qualifications

• Insurance industry experience.
• Experience supporting AI, Machine Learning, and Generative AI initiatives.
• Experience implementing enterprise data governance programs.
• Success leading large-scale cloud migration or data modernization programs.
• Experience with observability, operational monitoring, and reliability engineering.