Help strengthen the safety, quality, and alignment of frontier AI models by evaluating their responses across complex, policy-sensitive, and ambiguous topics. This role focuses on structured assessment and feedback that improves model behavior in high-impact real-world domains.
Key Responsibilities- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review material involving misinformation, political persuasion, self-harm, violence, cyber topics, biosecurity, and other sensitive areas.
- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
- Bachelor''s degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- At least 5 years of professional experience in AI safety, trust and safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English, critical-thinking, and analytical-reasoning skills.
- Ability to consistently evaluate nuanced, policy-sensitive scenarios.
- Experience with AI safety, RLHF, SFT, trust and safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation-rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
- Remote hourly engagement.
- 60 to 70 per hour.
- Shape the safety and behavior of frontier AI models used by millions of people worldwide.
- Work on challenging safety evaluations across nuanced, high-impact domains.
- Collaborate with AI researchers, engineers, and safety teams.
AI Safety Practitioner for Model Evaluation in Fort George G Meade at Unknown Company
This position is listed as full time and able to be worked remotely.