- Design and develop robust evaluation rubrics to assess AI model outputs from a user experience (UX) perspective.
- Execute product validation tasks to identify risks that could negatively impact user experience, safety, or accuracy.
- Analyze AI outputs to flag usability issues, inconsistencies, or potential failure modes.
- Collaborate with cross-functional teams to define, refine, and uphold product validation and safety standards.
- Translate user insights and evaluation findings into clear, actionable recommendations for model improvement.
- Document results and recommendations with clarity to ensure stakeholders understand user impact.
- Continuously monitor evolving AI product usage and proactively surface emerging UX risks or concerns.
Requirements
- Exceptional written and verbal communication skills with a strong focus on clarity and precision.
- Strong analytical skills and attention to detail when evaluating user risk and usability issues.
- Experience developing and applying evaluation frameworks balancing UX, safety, and performance.
- Ability to clearly document complex findings in an actionable, user-friendly manner.
- Comfortable collaborating across teams in a fast-paced, evolving project environment.
- Self-directed and reliable in a fully remote setting.
#J-18808-Ljbffr