Azure Databricks Administrator

Job Title: Azure Databricks Administrator

Skills: Azure Data, Terraform, Azure Databricks, CD, Unity3D, Azure Fundamentals

Experience: 8+ Years

Location: Wilmington, DE

We at Coforge are hiring Azure Databricks Administrator with the following skillset:

• Administer and optimize Azure Databricks clusters, including autoscaling configurations and performance tuning.
• Manage jobs and workflows, ensuring effective scheduling, concurrency controls, and alerting mechanisms.
• Oversee workspace assets such as notebooks, libraries, and secret scopes.
• Implement and maintain Unity Catalog for enterprise data governance, including access controls and security measures.
• Utilize Databricks automation tools (CLI, REST APIs, Asset Bundles) for deployment and management tasks.
• Integrate Databricks with BI tools and analytics platforms to enhance data accessibility.
• Support compliance-driven environments through audit documentation, access reviews, and change management.
• Build and maintain CI/CD pipelines using GitLab CI/CD, ensuring efficient deployment strategies.
• 5+ years of hands-on experience administering Azure Databricks platforms.
• Strong experience with Unity Catalog and enterprise data governance models.
• Proficiency in Terraform, including modular design and secure infrastructure practices.
• Experience with CI/CD pipelines, particularly using GitLab CI/CD.
• Solid understanding of data engineering patterns and Spark-based workloads.
• Working knowledge of Microsoft Azure fundamentals, including RBAC, Azure Data Lake Storage, and Azure networking concepts.
• Demonstrated experience in compliance-driven environments.
• Deal Breaker: Proven experience with Azure Data.