Remote Data Labeling Specialist (Portland)

Rex.zone is hiring a Remote Data Labeling Specialist (Portland) to create and evaluate training data for modern AI systems. You will label and review text, images, and multimodal content used in LLM evaluation, RLHF workflows, and computer vision annotation, collaborating asynchronously with QA leads and ML teams.

What You Will Do

• Execute data labeling and data annotation across NLP and computer vision workflows (NER, classification, ranking, structured extraction)
• Support RLHF via preference labeling, rubric scoring, prompt evaluation, and response quality judgments
• Perform QA evaluation: audit labeled datasets, resolve edge cases, and enforce annotation guidelines compliance
• Contribute to content safety labeling (toxicity, self-harm, regulated topics) with policy-based tagging
• Document decisions, escalate ambiguous examples, and help refine instructions to improve training data quality

• LLM training pipelines: prompt/response grading, factuality checks, instruction-following evaluation
• RLHF: pairwise preference labeling, reward model data generation, disagreement resolution
• NLP: named entity recognition, intent classification, sentiment/stance labeling
• Computer vision: bounding boxes, polygons, keypoints, attribute tagging
• QA evaluation: sampling plans, inter-annotator agreement checks, targeted rework

• Mid-Senior experience in data labeling, data annotation, or QA evaluation for ML datasets
• Ability to follow complex annotation guidelines, handle edge cases, and maintain consistent quality
• Familiarity with NLP (e.g., named entity recognition) and/or computer vision annotation fundamentals
• LLM evaluation and prompt evaluation experience preferred; RLHF exposure is a plus
• Strong written communication and ability to collaborate asynchronously in a remote environment

This is a Remote, FULL_TIME role aligned to Portland, Oregon candidates or those seeking Portland-aligned remote opportunities. Work is performed online using secure annotation tools and task platforms.

Pay

$30–$50 per hour (hourly base pay range).