Outreach.io
Himalayas · Posted 8d ago
Staff Test Engineer - AI
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Outreach is seeking a Staff Test Engineer - AI to own quality for their GenAI platform and agent ecosystem. The ideal candidate will have experience testing complex, probabilistic systems at scale and a genuine curiosity about how AI and LLM-based systems behave, fail, and improve.
Requirements
- 7–12 years of experience in software development and/or test automation
- B.S. in Computer Science or a related technical field
- Strong programming skills in Python
- Proven experience testing large-scale backend or platform systems
- Deep understanding of test design principles, CI/CD integration, and scalable test automation
- Experience with test frameworks such as PyTest or equivalent
- Solid understanding of evaluation methodologies for non-deterministic systems
- Hands-on experience with Databricks for building and validating ML pipelines and data workflows
- Experience with MLflow for experiment tracking, model versioning, and pipeline observability
- Strong communication and collaboration skills across engineering, data science, and product functions
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Tuition Reimbursement
Originally posted on Himalayas
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If the repetitive CV tweaking gets heavy, Daniel can help set up Caio Agent.
Ask about Agent
