Sr. Data Engineer (Azure/Databricks/Python)

Responsible for delivering senior level innovative and compelling software solutions for our consumer, internal operations, and value chain constituents across a wide variety of enterprise applications. The job duties and requirements are defined for backend. Provides technical leadership and mentorship to junior team members.

Responsibilities

• Designs, develops, and delivers solutions that meet business line and enterprise requirements.
• Creates data and reporting infrastructure by building and optimizing production-grade data pipelines using continuous integration/ continuous deployment.
• Participates in rapid prototyping and POC development efforts.
• Understand business and technical requirements and constraints to design effective data engineering solutions.
• Assists in efforts to develop and refine functional and non-functional requirements.
• Champion engineering excellence, including software design patterns, code reviews and automated unit/functional testing.
• Create conceptual architectures and detailed designs for data engineering solutions.
• Contributes to overall enterprise technical architecture and implementation best practices.
• Participates in iteration and release planning.
• Performs other duties and projects as assigned.

Qualifications

Bachelor’s Degree required, and a minimum of five plus related work experience.

Required Skills

• Design and implementation of data lake, data warehouse and data mart.
• Web API, REST, GraphQL, XML/JSON.
• ETL/ELT, and one of data engineering languages (Python/Java/Scala).
• ADF, ADLS, Airflow, DBT and any of cloud-native data warehouse (Snowflake, Databricks, BigQuery).
• Strong SQL experience, with expert-level skills in query performance tuning and data modeling.
• Designs enterprise database systems using Microsoft SQL Server.
• Has working knowledge of GIT. Develops branching and merging strategies.
• Ability to design, develop, and maintain scalable, reusable code.
• Estimates tasks with a level of granularity and accuracy commensurate with information provided to ensure expectations of delivery are reasonable.
• Excels in a rapid iteration environment with short turnaround times.
• Knowledge of cubes and SSAS is a plus.
• Knowledge of SSRS, Power BI, and Tableau a plus.

Preferred Skills

• Knowledge of cubes and SSAS is a plus.
• Knowledge of SSRS, Power BI, and Tableau a plus.