DevOps Engineer

About the Role

We're looking for a DevOps Engineer to build the infrastructure foundation that keeps our AI-powered product fast, reliable, secure, and cost-efficient. You'll set up the cloud, deployment, and monitoring systems that let a small team ship confidently and scale smoothly through the pilot and beyond.

What You'll Do

• Design, provision, and manage cloud infrastructure (AWS, GCP, or Azure)
• Build and maintain CI/CD pipelines for fast, safe, automated deployments
• Implement infrastructure-as-code (Terraform, Pulumi, or similar) for reproducible environments
• Containerize and orchestrate services (Docker, Kubernetes) as the system grows
• Set up observability: monitoring, logging, alerting, and tracing across the stack
• Manage and optimize the cost, latency, and reliability of LLM and AI workloads
• Own security, secrets management, and access controls across environments
• Establish backup, disaster-recovery, and incident-response practices for the pilot

• 4+ years of DevOps, SRE, or infrastructure engineering experience
• Strong hands-on experience with at least one major cloud provider (AWS/GCP/Azure)
• Proficiency with infrastructure-as-code tools (Terraform, Pulumi, CloudFormation)
• Experience with containerization and orchestration (Docker, Kubernetes)
• Solid CI/CD experience (GitHub Actions, GitLab CI, CircleCI, or similar)
• Strong scripting skills (Bash, Python, or Go)
• Experience implementing monitoring and observability tooling (Prometheus, Grafana, Datadog, etc.)
• Security-first mindset and experience with secrets and access management

• Experience managing infrastructure for AI/ML or LLM-heavy workloads
• Familiarity with cost optimization for high-throughput API usage
• Experience with GPU infrastructure or inference serving
• Early-stage experience standing up infrastructure from scratch

Originally posted on Himalayas