Application QA Engineer (Mid-Level)
Indexed description
The Role
We're looking for an Application QA Engineer to own quality across Sophie's advisor-facing product. You'll be our first dedicated QA hire, responsible for building our test automation framework, establishing quality processes, and ensuring that every feature advisors rely on — during live client calls — works flawlessly. This is a hands-on, high-ownership role. You'll define how we test, what we automate, and what "ready to ship" means.
What You'll Do
Own Test Automation
- Build and maintain our E2E test automation framework using Playwright
- Create and expand regression test suites covering critical advisor workflows
- Implement visual regression testing to catch UI inconsistencies across browsers and devices
- Set up component-level testing with React Testing Library + Vitest
- Integrate automated test suites into CI/CD pipelines (GitHub Actions)
- Set up and maintain error tracking and monitoring (Sentry)
- Build test coverage dashboards for team visibility
- Own the release testing checklist — define what must pass before deployment
- Create a bug taxonomy and triage process — severity levels, SLAs, reproduction templates
- Manage bug tracking workflows across Linear and Notion
- Define the QA sign-off process — no feature ships without QA approval
- Every confirmed bug gets an automated regression test so it never recurs
- Audit the app end-to-end — document every user flow, edge case, and known issue
- Perform cross-browser and cross-device testing
- Establish performance baselines — load times, streaming response rendering
- Build and own the pre-launch quality gate for production release
Must Have
- 3+ years of QA experience with at least 2 years in test automation
- Proficiency with Playwright or Cypress — writing tests from scratch
- Comfortable with TypeScript and testing within a React/Next.js codebase
- Experience integrating test suites into CI/CD pipelines
- Strong understanding of API contract testing
- Solid bug documentation skills — clear reproduction steps, severity classification
- Experience with visual regression testing tools (Percy, Chromatic, or Playwright screenshots)
- Component testing experience with React Testing Library
- Familiarity with error tracking platforms (Sentry, Datadog)
- B2B SaaS background, especially professional services or financial contexts
- Experience testing streaming/real-time UI
- Exposure to performance testing or load testing fundamentals
- Self-directed and proactive — you find bugs before anyone reports them
- Strong written communication — async-first remote culture requires clarity
- Pragmatic about coverage — you know what to automate and what to test manually
- Collaborative mindset — QA doesn't exist in isolation
- Opinionated about quality — you'll propose tools and processes, not wait to be told
- Not a manual-only QA role — automation is the core of this position
- Not a DevOps role — you'll configure test pipelines, not manage infrastructure
- Not an AI/ML testing role — a separate role handles LLM evaluation
- Not a management role — near-term focus is individual contribution
- Not passive — we need someone who drives quality standards
EquityMeaningful early-stage grant with 4-year vesting
EquipmentTo be decided
Time OffFlexible PTO with minimum 15 days encouraged
LearningAnnual professional development budget
ScheduleFlexible hours with 3–4 hours daily overlap Americas timezones
Interview Process
1
Resume Review— 1–2 day turnaround
2
Technical Screen— 60 min video conversation with CTO
3
Take-Home Assessment— 4–5 hours (automation challenge)
4
Assessment Deep Dive— 75 min collaborative review
5
Values & Fit— 45 min conversation
6
References & Offer
Total timeline: 2–3 weeks
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search