Back to search
ITCAPS LLC Linkedin · Posted 5d ago

Infrastructure Engineer (Kubernetes, GPU/NVIDIA, Terraform)

St Louis

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Introduction

We are seeking a highly skilled AI Infrastructure Engineer to design, build, and support scalable GPU-enabled Kubernetes platforms for AI/ML workloads. The ideal candidate will have strong expertise in Kubernetes, Linux, Terraform, and NVIDIA GPU technologies, with experience building enterprise-grade AI infrastructure.

Responsibilities

  • Design, deploy, and manage production-grade Kubernetes clusters
  • Build and maintain GPU-enabled infrastructure for AI/ML workloads
  • Deploy and manage Longhorn storage solutions
  • Automate infrastructure provisioning using Terraform
  • Monitor and optimize platform performance using Prometheus and Grafana
  • Troubleshoot Kubernetes, GPU, storage, and infrastructure issues
  • Collaborate with ML engineers, data scientists, and DevOps teams
  • Create technical documentation, runbooks, and operational guides
  • Conduct knowledge transfer (KT) sessions and hands-on workshops for client teams
  • Provide guidance on Kubernetes operations, NVIDIA GPU management, Longhorn storage, and Canonical ecosystem tools
  • Advise on cloud-native infrastructure, AI/ML platform best practices, scalability, reliability, and cost optimization
  • Ensure successful production handoff with full operational readiness

Requirements

Must-Have Skills

  • Strong hands-on experience with Kubernetes
  • Expertise in Linux (Ubuntu)
  • Experience with Terraform (Infrastructure as Code)
  • Experience with GPUs and NVIDIA Stack (CUDA, NVIDIA GPU Operator, device plugins, scheduling)
  • Strong troubleshooting and automation skills

Preferred Skills

  • Experience with Longhorn or Ceph storage
  • Knowledge of Canonical ecosystem (MAAS, Juju, Charmed Kubernetes)
  • Experience with Kubeflow or other AI/ML platform tools
  • Certifications such as CKA or NVIDIA Certified

Required Skills

  • Kubernetes
  • Linux (Ubuntu)
  • Terraform
  • NVIDIA GPU Stack
  • GPU Infrastructure
  • Prometheus
  • Grafana
  • AI Infrastructure
  • Infrastructure Automation

Nice to Have

  • Longhorn
  • Ceph
  • Kubeflow
  • MAAS
  • Juju
  • Charmed Kubernetes
  • CKA Certification
  • NVIDIA Certification
Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search