Senior Software Engineer - Model Evaluation & AI Systems

Deepgram Senior Software Engineer - Model Evaluation & AI Systems 2 Hours AgoSaved Remote USA 180K-240K Annually Senior level 180K-240K Annually Senior levelArtificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AIDesign and build scalable, automated evaluation pipelines and infrastructure to validate speech, audio, and multimodal models. Translate research benchmarks into enforceable pass/fail gates, run batch and streaming tests, operate canaries and continuous monitoring, integrate quality gates into CI/CD, and partner with research, training, inference, and infra teams to prevent regressions and ensure production model quality.Top Skills: Agent FrameworksAnomaly DetectionCi/CdContainersDockerGoGpu ClustersGrafanaKubernetesLlmsMultimodal ModelsPythonRagReact NativeRust