Principal GenAI Platform Engineer (US)

The Principal GenAI Platform Engineer will design, build, and maintain the core infrastructure layer supporting GenAI products, and implement secure access controls and authentication mechanisms integrated by default into the AI platform components.

Requirements

• Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security.
• Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow).
• Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.
• Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.
• Experience with CI/CD pipelines and automation for AI model deployment and platform operations
• Strong knowledge of authentication and authorization frameworks integrated into AI platforms.

Benefits

• Bonus
• Benefits

Originally posted on Himalayas