Applied Scientist II: LLM Shopping Metrics

Amazon is seeking an Applied Scientist II to own LLM-based labeling for perception-driven defects within Core Shopping Data Science. You'll design prompts, sampling strategies, and balance model judgment with human annotation, validating against ground truth and maintaining gold datasets.

You will extend the measurement across shopping experiences, build reusable labeling and evaluation tooling, and define standards for teams using LLMs to measure customer experience.