Back to search
RADcube Linkedin · Posted 1mo ago

Senior Data Engineer - Databricks

Indianapolis

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Job Title: Senior AWS Data Engineer

Location: Indianapolis, IN

Role Overview

We are seeking a highly skilled AWS Data Engineer to support a strategic STRADA Modernization initiative. This role focuses on building and supporting a modern AWS + Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR). The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development, along with the ability to work closely with both technical and business stakeholders.

Key Responsibilities

  • Design, develop, and maintain data ingestion pipelines for real-world data (RWD) sources
  • Build and optimize data models within a Databricks Lakehouse architecture
  • Ensure data governance, quality, and compliance standards are met
  • Optimize cost, performance, and resource utilization across AWS and Databricks
  • Collaborate with business and technical stakeholders to translate requirements into scalable solutions
  • Provide technical guidance, coding standards, and best practices
  • Support knowledge sharing through documentation and training sessions
  • Deliver status updates and progress reports to senior leadership

Requirements

Required Qualifications

  • Strong hands-on experience with AWS services (S3, Glue, Lambda, Redshift, etc.)
  • Proven experience with Databricks (Delta Lake, notebooks, workflows)
  • Expertise in SQL and Python
  • Experience building end-to-end ETL/ELT data pipelines
  • Strong understanding of data modeling techniques
  • Experience with data governance, quality, and compliance frameworks
  • Ability to work independently and in a collaborative team environment
  • Databricks Certification
  • Experience building and managing CI/CD pipelines
  • Experience with workflow orchestration tools
  • Exposure to data observability and lineage tools
  • Experience with monitoring, logging, and observability frameworks

Highly Preferred Skills

  • Experience in Healthcare / Pharma domain
  • Exposure to RWD (Real World Data) or HEOR analytics
  • Familiarity with Lakehouse architecture / Medallion (Bronze-Silver-Gold) models
  • Experience optimizing cost and performance in cloud environments
  • Strong communication and stakeholder management skills
Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent