AI Task Designer — Materials & Mechanical Engineering

Obsidian in San Francisco is seeking a senior professional to design realistic AI evaluation tasks, including prompts, a data room, and objective grading criteria. You will author authentic tasks drawn from actual work and build rigorous benchmarks to distinguish model performance.

You'll collaborate with project leads and domain experts to define what constitutes good results and iterate until the criteria reliably discriminate model behavior.