Role Overview
Assess applied machine-learning tasks used to train and evaluate advanced AI models. You will evaluate experiment design, model-selection decisions, and evaluation methodology, then deliver clear written feedback using established rubrics. This is a role focused on applied and experimental ML rigor, not LLM application development or MLOps.
Key Responsibilities- Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks.
- Review experiment design, model-selection reasoning, and evaluation methodology.
- Provide clear, rubric-based written feedback.
- Critique machine-learning claims against supporting evidence and reproduce results when needed.
- At least 3 years of hands-on applied or experimental ML experience, including experiment design, model selection, hyperparameter tuning, and evaluation methodology.
- Strong data-quality rigor, including leakage detection, metric gaming, and appropriate train, test, and cross-validation practices.
- Proficiency with standard ML frameworks such as PyTorch, TensorFlow, scikit-learn, and XGBoost.
- Ability to assess ML claims against evidence and reproduce results.
- Competition or benchmark experience, such as Kaggle.
- Graduate research experience or a publication record in applied ML.
- Prior task-grading or peer-review experience.
- Remote role, open to candidates located in the United States.
- Hourly engagement.
$70 to $90 per hour.
Machine Learning Task Auditor in Martindale at Unknown Company
This position is listed as full time and able to be worked remotely.