GenAI Evaluation Scientist: Benchmarks & Failures

Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation.

The role focuses on building benchmarks and diagnosing model failure modes in text and multimodal modalities within the GenAI Research Organization. You will develop rigorous evaluations, collaborate with researchers and engineers, and translate failure analysis into input for next-generation generative AI models.