Senior Director, Inference Products and Optimizations

DigitalOcean Senior Director, Inference Products and Optimizations Reposted 15 Hours AgoSaved In-Office Seattle, WA, USA 274K-343K Annually Senior level 274K-343K Annually Senior levelArtificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)Lead engineering for DigitalOcean's LLM inference product suite, owning Serverless/Dedicated/Router/Batch/Multimodal offerings. Drive model optimization, architecture, and hardware-aware inference (quantization, KV-cache, speculative decoding, disaggregated serving). Recruit and mentor teams, collaborate cross-functionally, ensure production health and SLAs, and institutionalize benchmarking, observability, and auto-tuning to deliver cost-efficient, high-performance inference at scale.Top Skills: AmdAuto-TuningContainer RuntimesDisaggregated ServingGpuKubernetesKv-CacheLlm-DMicroservicesNvidiaNvlinkQuantizationSglangSpeculative DecodingVllm