Drive excellence in AI data operations as a Remote Specialist. Focus on RLHF, data labeling, prompt evaluation, and ensuring content safety within high-quality training workflows.
This mid-senior role requires expertise in AI data operations or applied ML support. You will execute critical tasks, including RLHF evaluation and response grading, while adhering to annotation guidelines. Strong written reasoning skills are essential for effective rubric-based evaluations in this impactful position.
Key Responsibilities:
• Execute RLHF evaluation and preference ranking
• Perform prompt evaluation and response grading
• Complete data labeling tasks for classification and NER
• Conduct QA evaluations through audits and spot checks
• Document edge cases affecting LLM training pipelines
Requirements:
• Mid-senior experience in AI data operations
• Expertise in rubric-based evaluations
• Familiarity with large language model evaluation
• Experience with labeli...