Scale AI is looking for a Data Operations Lead to manage large-scale RLHF data annotation programs for frontier AI companies. You will design annotation guidelines, build quality assurance processes, and lead distributed teams of evaluators to produce high-quality training data.
Requirements
- 5+ years of experience in data operations or data quality
- Experience with human evaluation and annotation workflows
- Strong project management and team leadership skills
- Understanding of LLM training data requirements
- Experience with data quality metrics and frameworks
Nice to Have
- Experience with RLHF or preference data collection
- Background in computational linguistics
- Familiarity with Scale AI's platform
- Experience managing globally distributed teams
Equity in a unicorn AI company
Free meals and snacks
Team offsites
Skills
Data Operations RLHF Quality Assurance Project Management Annotation Leadership
#J-18808-LjbffrData Operations Lead — RLHF in northern at Unknown Company
This position is listed as full time and onsite.