Azure Databricks Admin
Indexed description
In the assigned Job Role of Domain Project Lead 1, your Area Of Responsibility will be as below:
- Develop project timelines, proactively identify and address resource discrepancies, to ensure timely project completion
- Act as a liaison between technical teams and clients, facilitating effective communication through regular meetings and milestone reviews
- Support functional teams in managing advisory and consulting initiatives focusing on domain specific product evaluation, benchmarking studies and domain specific system configurations
- Monitor project deliverables across all phases, to meet established quality benchmarks and stakeholder expectations
- Proactive risk management to ensure project delivery
- An ability to build collaborative relationships with stakeholders through effective communication
- Focused governance over project scope and identification of additional project opportunities
- Focus to anticipate challenges and deliver innovative solutions
- Commitment to balance project economics with adherence to strategic priorities
- Architecture and administration experience with Microsoft Azure Databricks
- Experience with platform automation, DevOps, and CI/CD pipelines
- Knowledge of cloud security, networking, and identity management
- Establish platform monitoring, observability, and automated alerting frameworks for Azure Databricks platform components
- Platform automation through Infrastructure-as-Code using Terraform, DevOps, and CI/CD pipelines.
- Implement capacity planning, disaster recovery, and high availability strategies.
- Expertise in managing Unity Catalog, and data access control mechanisms.
- Experience of managing Databricks cluster policies, instance pools, autoscaling, auto-termination, and compute governance
- Support platform upgrades, runtime migrations, and feature enablement.
- Administer Azure Databricks workspaces across Development, QA, Production & DR environments.
- Integrate Azure Databricks with Microsoft Entra ID (Azure AD).
- Manage RBAC, SCIM provisioning, user lifecycle management, and group synchronization.
- Implement and maintain Unity Catalog permissions and governance policies.
- Configure Key Vault-backed secret scopes and credential management.
- Support secure networking using:
- Private Endpoints
- VNET Injection
- NSGs
- Firewall Rules
- Managed Identities
- Implement enterprise governance standards using Unity Catalog.
- Maintain audit logging and compliance reporting.
- Troubleshoot platform, cluster, notebook, and job execution issues.
- Establish operational runbooks, incident management procedures, and SLA monitoring.
- Implement cluster policies to control costs and prevent resource overprovisioning.
- Manage platform operations, incident management, and change governance
- Design scalable, resilient, and secure platform solutions aligned with enterprise architecture standards.
- Establish best practices for platform architecture, governance, and security.
- Certifications in cloud architecture (Azure, Databricks) preferred
- ITIL knowledge for service management and operations governance
- Deliver platform health metrics, risk assessments, and operational reports.
- Ensure adherence to SLA, compliance, and operational standards
- Experience of supporting migration of legacy systems (like HMS) to Databricks on cloud platforms like Azure, AWS, or GCP.
- Skillset of integrating guidelines to configure and integrate Databricks with other existing security tools relevant to data access control.
- Experience in Azure Databricks, real time data ingestion, data warehouses, serverless ETL, No SQL databases, DevOps, Kubernetes, virtual machines, web/function apps, monitoring, and security tools.
- Optimize cluster utilization and DBU consumption.
- Utilize autoscaling, instance pools, spot instances, and workload optimization techniques.
- Produce usage, cost, and governance dashboards for stakeholders.
- Provide guidance on Databricks best practices and platform standards.
- Support onboarding of new projects and workloads onto the platform.
- Managed Kubernetes cluster and workload including network architecture
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- This position may require relocation and/or travel to work/project location.
- All applicants authorized to work in the United States are encouraged to apply.
- Medical/Dental/Vision/Life Insurance
- Long-term/Short-term Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
- 401(k) plan and contributions dependent on salary level
- Paid holidays plus Paid Time Off
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search