AI Automation Engineer

Hi

Our client is looking for a AI Automation Engineer project in Bellevue, WAbelow is the detailed requirement.

Job positing Title: AI Automation Engineer

Location: Bellevue, WA

Job description:

Bachelor’s degree in related field

ETL Pipeline,ML /AI,AI Ops (ML Ops, Agent Ops & LLM Ops) Workflow,Python , SQL,System Design,,MCP Client server design Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.

Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load. Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.

Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation