Senior Databricks Engineer (Ref:QxP5D)
Indexed description
An exciting opportunity to join our client's team at a global leader in fire and security solutions with over 200 years of heritage. We are looking for a Senior Databricks Engineer to join this organization.
Responsibilities
- Design and implement scalable Lakehouse architectures using Databricks, Delta Lake, and Unity Catalog.
- Develop and maintain ELT/ETL pipelines ingesting data from various sources into the Lakehouse.
- Write clean, efficient, and reusable PySpark, Python, and SQL code following SOLID principles.
- Implement CI/CD pipelines in Azure DevOps for automated testing and deployment.
- Provision and manage Databricks workspaces, clusters, and supporting Azure infrastructure using Terraform or Bicep.
- Govern data assets through Unity Catalog, enforcing fine-grained access control and lineage tracking.
- Implement automated data validation and quality monitoring using Great Expectations or DLT expectations.
- Maintain end-to-end data lineage visibility through Unity Catalog and Microsoft Purview integration.
- Coach and mentor junior and mid-level engineers, conducting code reviews and sharing best practices.
- Translate business requirements into robust technical solutions and communicate trade-offs clearly to stakeholders.
Requirements
- Expertise in Databricks including Delta Lake, Unity Catalog, and Delta Live Tables.
- Advanced PySpark and Python skills for distributed data processing.
- Strong SQL skills for query authoring, performance tuning, and data modeling.
- Experience with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics.
- Hands-on experience with Azure DevOps CI/CD and Infrastructure as Code tools like Terraform or Bicep.
- Knowledge of Data Warehousing concepts, dimensional modeling, and Lakehouse patterns.
- Experience with real-time data processing frameworks like Structured Streaming.
- Proficiency in data governance tools like Unity Catalog and Microsoft Purview.
- Implementation of automated data validation frameworks like Great Expectations.
- Familiarity with deploying Databricks projects using Databricks Asset Bundles (DABs).
Certifications
- Microsoft Certified
- Azure Data Engineer Associate
In addition to the salary, the company offers the following benefits
- Meal tickets, 40 RON/working day
- Medical priority subscription with Regina Maria
- Christmas gifts (for the employee and their children)
- Special events allowances (different amounts)
- Birthday, childbirth, medical needs or other special situations
- Professional and personal development by one of the following internal programs:
Global Leaders programs – one of our core values is Building Great Leaders and we truly believe everyone is a leader in their own role.
Global Job Architecture (GJA) frame – gives you the ability to define a clear career path and identify the competencies you need to build or develop to reach the next level.
Individual Development Plan (IDP) - your short / mid / long term career plan within the company.
What is RSight®
RSight® is a next-generation recruitment solution, committed to the values of fairness, transparency, and human-centric hiring. RSight® aims to redefine recruitment, putting people and potential at the heart of every opportunity.
Application Instructions
Please submit your resume (mandatory) outlining your qualifications and interest in the position. By applying for this position, you acknowledge that your application may be shared with our clients for the purpose of evaluating your profile for relevant employment opportunities, in accordance with our Privacy Policy and applicable data protection laws. Only candidates selected for interviews will be contacted.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search