Remote Data Labeling Specialist (Manchester)
Remote Data Labeling Jobs in Manchester Rex.zone is hiring Remote Data Labeling Specialists targeted to Manchester candidates. You will create and review labeled datasets used to train and evaluate AI models, including NLP, computer vision, content safety labeling, and large language model evaluation workflows (RLHF and prompt evaluation).
What You Will Do
- Label and review text and multimodal data for NLP and computer vision annotation tasks
- Perform RLHF preference ranking and QA evaluation to support large language model evaluation
- Execute prompt evaluation for instruction-following, truthfulness, and helpfulness signals
- Apply content safety labeling policies with consistent rationale and documentation
- Track training data quality metrics (gold sets, consensus review, adjudication outcomes, agreement rates) and escalate guideline gaps
- Maintain clear audit trails: decision notes, disagreement reasons, and edge-case documentation
- Work in secure environments and follow data handling and confidentiality requirements
- Mid-Senior experience in data labeling, data annotation, QA evaluation, or related data operations roles
- Strong attention to detail and ability to follow complex annotation guidelines compliance
- Experience with named entity recognition (NER), classification taxonomies, or structured labeling schemas
- Comfort working with ambiguous language and edge cases in LLM training pipelines
- Ability to communicate labeling rationale clearly and consistently for reviewer alignment
- Stable internet connection and ability to work effectively in a fully Remote setup
Workplace Type: Remote (Manchester-targeted).
