Back to search
Circle (circle.so) Builtin · Indexed 2026-09-23

Lead Engineer, AI Quality

In- or Remote, Oregon, United States 170K-170K Annually Remote

Senior level Builtin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Circle (circle.so) Lead Engineer, AI Quality An Hour AgoSaved In-Office or Remote 2 Locations 170K-170K Annually Senior level 170K-170K Annually Senior levelArtificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • SoftwareLead the AI Quality engineering team while building evaluation infrastructure, observability tools, diagnostic systems, datasets, annotation workflows, and experimentation frameworks for production AI agents. Diagnose agent failures, evaluate models and prompts, improve quality, latency, and cost, and partner with AI Core engineering. This is a hands-on player-coach role involving technical direction, team management, and production software development.Top Skills: Ai AgentsAnnotation WorkflowsBraintrustCachingCi/CdDatasetsLangsmithLlmsMachine Learning EvaluationModel RoutingObservability ToolingPythonRuby On Rails

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search