Senior Engineer II, Serverless Inference
Indexed description
DigitalOcean Senior Engineer II, Serverless Inference 30 Minutes AgoSaved Hybrid Seattle, WA, USA 167K-209K Annually Senior level 167K-209K Annually Senior levelArtificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)Design and optimize scalable, multi-tenant serverless inference infrastructure and APIs for large-scale AI workloads. Build highly available distributed services, improve GPU utilization, observability, capacity management, fault tolerance, and operational automation. Partner with platform and GPU infrastructure teams, contribute to architecture decisions, participate in on-call and incident response, and provide technical leadership and mentorship to engineers.Top Skills: Api GatewaysCloud-Native ArchitecturesDistributed SystemsGoGpu InfrastructureKubernetesLlm ServingMicroservicesObservabilityService MeshSreTensorrt-LlmTritonVllm
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search