Unknown Company

Anesthesiologist for AI Model Evaluation

san francisco, ca • Posted 3 days ago
Remote Full Time healthcare
Role Overview

Anesthesiologists apply clinical anesthesia experience to evaluate and improve AI model outputs related to anesthesia care. This is an hourly, temporary research role that does not require prior AI experience. You will use your day-to-day clinical knowledge to assess AI-generated content, provide structured feedback, and help refine how models understand anesthesia tasks and language.

Key Responsibilities
  • Develop prompts that reflect real-world anesthesia scenarios and clinical tasks.
  • Evaluate AI model responses for clinical accuracy, appropriateness, and usefulness in anesthesia care.
  • Deliver clear, structured feedback and examples that help models better emulate professional practice.
  • Assess content related to perioperative management, airway and life support systems, anesthetic technique selection, and patient recovery considerations.
  • Collaborate asynchronously with AI research teams by completing assigned evaluation tasks and follow-up reviews.
Qualifications
  • Minimum of 4 years of professional experience as an anesthesiologist or in closely related anesthesia roles.
  • Clinical experience may include administering and monitoring anesthesia during procedures, managing airway and life support systems, determining anesthetic methods with surgical teams, overseeing postoperative recovery, and educating staff or residents on anesthesia techniques and emergency response.
  • Comfort with asynchronous, independent work and following structured evaluation guidelines.
  • No prior AI or machine learning experience required; the role focuses on clinical domain expertise.
Work Terms
  • Remote and asynchronous, work independently from any location.
  • Part-time, hourly engagement; this is a temporary research assignment.
  • Flexible schedule with no minimum weekly commitment, though most contributors average 5 to 20 hours per week.
  • Placement into specific projects depends on project availability, and opportunities open periodically throughout the year.
Compensation

Up to $300/hr (depending on the project)

Eligibility and Work Authorization
  • Participants must be authorized to work under the applicable rules for the program. F-1 students with eligible CPT or OPT authorization may qualify, but you must consult your Designated School Official to confirm eligibility. If your school requires enrollment in a CPT course for off-campus work, the program may not meet that requirement.
  • STEM OPT is not supported for participation.
Application Process
  • Create an account on the program platform.
  • Upload your resume and complete identity verification.
  • Complete any onboarding required to be matched with relevant projects.
  • Begin assigned evaluations and receive payment for completed work.
Back to Job Search