Hercules is seeking a senior or staff product manager to own evals for our AI coding agent in San Francisco. You will direct Hercules Bench offline evals and Hercules online evals, shaping how we measure performance using our huge user and code repository base.
You will craft evaluation methodologies, balance speed, cost, and accuracy, and ensure privacy through data anonymization while working with core stack technologies like TypeScript and React.
#J-18808-LjbffrStaff Technical PM — AI Coding Evals & Platform in san francisco at Unknown Company
This position is listed as full time and onsite.