Risk Operations AI Specialist
Indexed description
Binance's Risk Operations team is executing an AI-First transformation — moving from manual case review toward a fully autonomous decision pipeline powered by ROCA (Risk Operations AI Agent). This role sits at the critical human-in-the-loop node: reviewing cases where ROCA's confidence score falls below the auto-decision threshold, generating structured feedback that drives continuous model improvement, and progressively expanding the automation boundary.This is not a traditional fraud analyst role. Think of it like the shift from manual labor to the steam engine era — the people who thrived weren't the ones who resisted the machine, but those who learned to operate it. Here, you are the operator: you direct the AI, validate its judgment, correct its blind spots, and steer it toward better outcomes. The machine handles the volume; you provide the expertise it can't yet replicate.
Responsibilities:
Core Review Duties
- Review cases escalated by ROCA where confidence score falls below the auto-decision threshold, using AI-assisted signals within the unified case review UI (no multi-system switching)
- Make accurate pass / block / escalate decisions on a daily queue spanning KYC Audit, ATO investigation, Reset 2FA, POA Review, and Withdrawal anomaly case types etc.
- Escalate Key User cases (Priority ≥ 75) and high-risk patterns to Senior Agent / Team Lead with clear rationale documentation
- Maintain SLA compliance (
AI Feedback & Pipeline Contribution
- Label every reviewed case as TP / TN / FP / FN with structured root-cause annotations — this data directly feeds ROCA's continuous learning pipeline
- Identify recurring FP/FN patterns and route them through the correct feedback path:
- Type A — Feature weight bias → trigger model retraining / fine-tune
- Type B — Threshold miscalibration → update Decision Hub rules (with A/B validation)
- Type C — SOP gap or logic error → update SOP (version-tracked)
- Actively contribute to improving Precision (>95%) and Recall (>99%) targets by surfacing systematic signal failures to Data and Model teams
- Participate in regular AI model calibration sessions: review misclassification batches, validate ground truth, challenge decision thresholds with data
SOP & Knowledge Management
- Maintain and update Confluence SOP pages for assigned case types; SOP coverage rate target ≥ 80% (directly impacts ROCA first-pass accuracy)
- Flag SOP coverage gaps when ROCA's reasoning chain reveals unhandled scenarios; draft SOP additions for Team Lead review
- Onboard and calibrate BPO agents on AI-assisted review workflows; monitor BPO quality against automated QA benchmarks
Requirements:
- 2+ years in fraud review, risk operations, or KYC/KYB case management
- Hands-on experience with ATO (Account Takeover) detection and investigation
- Comfort working in AI-augmented workflows: you read model outputs, interpret confidence scores, and make decisions based on AI-generated signals rather than raw data alone
- Structured, precise written communication: you can document a root-cause annotation in
- Bilingual English/Mandarin is required to be able to coordinate with overseas partners and stakeholders.
- An operator's mindset toward AI tools: you leverage AI signals to make faster, better decisions — you master the tool rather than compete with it
Nice to have:
- Experience in crypto / Web3 / VASP risk environment; familiarity with blockchain transaction patterns (Sybil attacks, wash trading, mule account indicators)
- Exposure to ML model evaluation concepts: Precision, Recall, F1, confusion matrix — you don't need to build models, but you need to speak the language
- Familiarity with prompt engineering or LLM evaluation workflows; experience reviewing or testing AI-generated decisions at scale
- CAMS, CFE, or equivalent AML / fraud certification
- Prior involvement in SOP authoring, QA calibration, or BPO oversight for a risk operations team
Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search