Platform Engineer

Databricks Platform / DevOps Engineer (Azure)

Hybrid - 2 days a week in the office in Madrid

ABOUT THE ROLE

As a Databricks Platform Engineer within the Infrastructure function, you will focus on the secure, scalable, and reliable operation of a Databricks platform in the Azure cloud. You will play a key role in automating infrastructure, integrating platform capabilities into broader enterprise services, and ensuring strong networking, storage, and governance alignment.

You will collaborate closely with platform, security, and data teams to deliver a high-performing and compliant analytics environment.

YOUR RESPONSIBILITIES

• Administer and operate Databricks workspaces, jobs, clusters, and Unity Catalog across multiple environments
• Automate infrastructure provisioning and platform operations using Terraform, CI/CD pipelines, and Databricks APIs
• Ensure robust network integration, including secure VNet peering, firewall rules, and private endpoint configurations
• Support integration with Azure Blob Storage, ensuring efficient and secure data access for ingestion and analytics use cases
• Configure and troubleshoot external database connections (e.g. via JDBC) and downstream system integrations
• Manage access control and identity using SCIM, Azure Active Directory, and role-based permissions across workspaces and Unity Catalog
• Implement and maintain platform observability through telemetry pipelines (e.g. Datadog, Grafana, Dagster/Dragster)
• Collaborate with security teams to ensure compliance with policies and standards (e.g. encryption, audit logging, GDPR)
• Contribute to API integrations, including working with API gateways to interface Databricks workloads with internal and external services
• Develop and maintain platform documentation, reusable modules, and operational runbooks
• Act as a technical point of contact for platform-related issues and incident resolution

WHAT YOU BRING

• Degree in Computer Science, IT, or a related technical field
• Proven experience operating Databricks in enterprise or cloud-native environments
• Strong hands-on expertise in Azure networking (VNet integration, firewalls, and network security controls)
• Experience integrating Databricks with Azure Blob Storage, external databases, and enterprise APIs
• Working knowledge of API gateways (e.g. Azure API Management) and secure API exposure/consumption
• Proficiency in Terraform, Azure DevOps, and scripting languages such as Python or Shell
• Solid understanding of authentication, authorization, and identity federation in cloud environments
• Experience with cost monitoring and performance optimisation in Databricks and Azure
• Strong communication skills with a collaborative, team-oriented mindset
• Fluent English

TECHNOLOGIES YOU’LL WORK WITH

• Cloud & Infrastructure: Microsoft Azure, Azure VNet, Private Endpoints, Blob Storage, API Management
• Data Platform: Databricks, Delta Lake, Unity Catalog, Spark
• IaC & Automation: Terraform, Azure DevOps, GitHub/Bitbucket, CI/CD
• Integration & Scripting: Python, REST APIs, JDBC, SCIM
• Observability: Datadog, Grafana, Dagster/Dragster
• Other: Docker, Linux, Azure Active Directory

NICE TO HAVE

• Experience with multi-workspace governance and account-level Databricks configurations
• Familiarity with container platforms (e.g. AKS, Docker)
• Experience working in regulated environments (e.g. energy, finance)
• Knowledge of orchestration tools such as Airflow or Dagster