Azure Data Engineer

Job Description

Title : Azure Data Engineer

Location : Chicago, IL (3 days onsite/Week)

Type of Employment : - Contract

Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms with Palantir or Oncology experience.

Interview : - Final client interview will be in person interview at chicago, IL.

Mandatory Skills

• 10+ years of experience as a Database Developer or similar role.
• Strong expertise in SQL Server and Azure SQL.
• Advanced proficiency in T-SQL, including performance tuning and query optimization.
• Hands-on experience with Databricks and Apache Spark.
• Solid understanding of data warehousing concepts, dimensional modelling, and SCD.
• Experience working in Azure cloud environments.
• Strong analytical, problem-solving, and communication skills.
• Experience with Palantir Foundry or Oncology projects.

Roles and Responsibilities

• Database Development & Optimization: Design, develop, and maintain complex SQL Server and Azure SQL databases.
• Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
• Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
• Implement best practices for database security, data integrity, and reliability.
• Cloud & Data Platform:
• Develop and manage data solutions in Azure SQL Database.
• Work with Databricks (Apache Spark) to support data transformations, analytics, and large-scale data processing.
• Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
• Support cloud-based data architectures and hybrid data environments.
• Data Modelling & Warehousing:
• Design and maintain relational and dimensional data models.
• Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
• Support ETL/ELT processes and collaborate with data engineering teams.
• Collaboration & Leadership:
• Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
• Provide guidance and mentoring to junior developers.
• Participate in code reviews and enforce database development standards.
• Troubleshoot production issues and provide root cause analysis.

Experience : - 10+ Years

Duration: - 12 Months

Educational Qualifications

• Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.