Senior Engineer, Inference Data Plane

DigitalOcean Senior Engineer, Inference Data Plane YesterdaySaved In-Office Denver, CO, USA 139K-174K Annually Senior level 139K-174K Annually Senior levelArtificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)Lead design and delivery of high-scale, resilient distributed inference data plane services. Architect and optimize inference hosting (tensor/data parallelism, KV-cache routing, prefill/decode disaggregation), contribute upstream open-source projects, mentor engineers, and maintain operational excellence and SLOs for a multi-tenant AI inference cloud.Top Skills: GoGrpcKserveKubernetesKv-CacheLlm-DModular MaxNixlNvidia DynamoPythonRay ServeSglangTensorrtTensorrt-LlmTgiVllm