Remote AI Data Annotation Specialist (Miami)
Indexed description
Key Responsibilities
- Annotate and review text datasets for NLP tasks such as classification and named entity recognition
- Perform RLHF tasks including preference ranking and rubric-based scoring
- Conduct prompt evaluation and QA evaluation to identify edge cases, label noise, and guideline gaps
- Label computer vision data (bounding boxes, polygons, keypoints, segmentation masks) and validate accuracy
- Apply content safety labeling and policy-based moderation labels for sensitive content categories
- Document decisions, propose improvements to annotation guidelines, and support calibration sessions
- Track quality metrics (disagreement rates, audit pass rates) and contribute to training data quality initiatives
- Mid-Senior experience in AI data annotation, data labeling, or QA evaluation/data operations
- Familiarity with LLM evaluation concepts, RLHF workflows, and rubric-based scoring
- Strong written communication and ability to justify labeling decisions with clear rationale
- High attention to detail and consistent annotation guidelines compliance
- Comfort working remotely in a metrics-driven production environment with iterative feedback
Remote Type: Remote (Miami-based search intent; eligible across the US).
How To Apply
Apply via Rex.zone and be prepared to summarize your experience across NLP labeling, computer vision annotation, RLHF, prompt evaluation, and QA evaluation.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search