Outreach.io
Himalayas · Posted 1mo ago
Staff Test Engineer - AI
Continue to application
Add your email once, then Caio opens the original posting.
Indexed description
Outreach is seeking a Staff Test Engineer - AI to own quality for their GenAI platform and agent ecosystem. The ideal candidate will have experience testing complex, probabilistic systems at scale and a genuine curiosity about how AI and LLM-based systems behave, fail, and improve.
Requirements
- 7–12 years of experience in software development and/or test automation
- B.S. in Computer Science or a related technical field
- Strong programming skills in Python
- Proven experience testing large-scale backend or platform systems
- Deep understanding of test design principles, CI/CD integration, and scalable test automation
- Experience with test frameworks such as PyTest or equivalent
- Solid understanding of evaluation methodologies for non-deterministic systems
- Hands-on experience with Databricks for building and validating ML pipelines and data workflows
- Experience with MLflow for experiment tracking, model versioning, and pipeline observability
- Strong communication and collaboration skills across engineering, data science, and product functions
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Tuition Reimbursement
Originally posted on Himalayas
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search
Want help applying to roles like this?
Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent
