Senior AIOps Engineer

Role: Senior AIOps Engineer

Location: Hyderabad (Onsite)

Job Type: Fulltime/Permanent

This role will be the founding Senior AIOps Engineer embedded in the GIRC team. You will design and build the end-to-end AIOps platform that powers intelligent alert triage, proactive monitoring, auto-remediation, and Infrastructure as Code across Salesforce's global footprint.

You will partner with on-call engineers, infrastructure SMEs, and the tooling/automation team to identify the highest-impact automation opportunities and turn them into production systems. You will own the platform architecture, drive design decisions, and mentor team members on AIOps and software engineering best practices.

You will be building with and on top of:

• PagerDuty (incidents, event orchestration, webhooks)

• Slack (bots, event subscriptions, channel-based workflows)

• LLM APIs (Claude, or equivalent) for intelligent triage and RCA generation

• AWX / Ansible Tower for playbook-driven remediation

• Docker and Kubernetes for packaging and deploying AIOps services

• Terraform and Ansible for Infrastructure as Code

• New Relic, LiveNX, and Zscaler for observability and telemetry

• AWS, Azure, and GCP for cloud infrastructure automation

• GitHub and CI/CD pipelines for code delivery

________________________________________

Responsibilities

• Design and build an LLM-powered alert triage pipeline that ingests PagerDuty incidents, correlates with historical data and runbooks, generates initial RCA, and posts structured summaries to Slack

• Build auto-acknowledgment and auto-remediation workflows for known incident patterns, with human-gated escalation for higher-risk actions

• Develop proactive monitoring capabilities that detect anomalies in infrastructure telemetry before they generate pages

• Operationalize remediation playbooks via AWX / Ansible Tower with full audit trails

• Codify infrastructure configurations (network, compute, cloud) as IaC using Ansible and Terraform; implement drift detection and CI/CD validation pipelines

• Containerize AIOps services with Docker and deploy on Kubernetes

• Build a runbook-as-code library that AI agents can query and execute

• Identify the top noise-generating alert patterns and systematically eliminate or automate them

• Coach and mentor team members on software engineering principles, AIOps patterns, and automation best practices

• Drive architecture decisions and own the platform end-to-end: design, build, operate

________________________________________

Minimum Qualifications

• Bachelor's degree in Computer Science, Engineering, or equivalent experience

• 7+ years of hands-on infrastructure engineering, SRE, or NOC/NRC experience

• 5+ years of Python development — production-grade services, not just scripts

• Strong software engineering fundamentals: clean architecture, API design, testing (unit, integration, end-to-end), error handling, observability

• Hands-on experience with LLM / AI integration — prompt engineering, tool use, agentic frameworks (LangChain, Claude API, OpenAI, or equivalent)

• Experience with PagerDuty API — incidents, event orchestration, alert grouping, webhooks

• Experience building Slack bots — event subscriptions, Block Kit, interactive workflows

• Proficiency with AWX / Ansible Tower — authoring and operationalizing playbooks at scale

• Strong Docker and Kubernetes experience — containerizing services, writing manifests, operating in production clusters

• Hands-on Terraform experience for multi-layer IaC

• Infra fundamentals — solid understanding across networking (routing, switching, SD-WAN, wireless), compute (bare metal, VMs, containers), storage, and OS operations

• Cloud platforms — hands-on experience with at least two of AWS, Azure, GCP; familiarity with cloud-native services (compute, networking, IAM, monitoring, serverless)

• Source code management with Git and CI/CD pipelines (GitHub Actions, Jenkins, Buildkite, or equivalent)

• Data formats: JSON, YAML, XML; REST and GraphQL API consumption

• Comfortable with agile practices and quality-driven development

________________________________________

Additional Desired Qualifications

• Experience with Prisma SD-WAN ( Cloudgenix) or equivalent

• Familiarity with PagerDuty AIOps / Event Intelligence features

• Experience with vector databases or RAG pipelines for runbook/knowledge retrieval

• Multi-cloud architecture experience across AWS + Azure + GCP simultaneously

• Knowledge of Zscaler ZPA / ZIA

• New Relic, Grafana, or Prometheus instrumentation experience

• Cisco, AWS, Azure, or GCP certifications

• Golang or Java experience (secondary to Python)

• NETCONF / YANG data modeling

• Prior experience in a GIRC, NOC, NRC, or SRE environment