About NewtonX NewtonX is a B2B insights company trusted by the world's most innovative companies to make high-stakes decisions with confidence. We combine a verified network of business professionals with AI-powered research tools to deliver research intelligence faster, more precise, and more defensible than traditional methods.
Our clients include Google, Microsoft, TikTok, DoorDash, Stripe, and Coinbase. NewtonX has raised $47M from investors including Two Sigma Ventures, Third Prime, XFund, and Citi Ventures.
NewtonX is turning the world’s largest verified expert network into the evaluation, post-training, and audit data that enterprises and AI labs need to deploy AI in production. We build high-quality, expert-generated datasets that train and evaluate frontier AI systems — spanning domain eval sprints, custom data solutions, model behavior audits, agentic RL environments, and domain QA-as-a-service.
We are hiring a Project Lead to own client engagements end to end, from scoping through delivery, on our data operations platform. You will be the client’s point of contact and the person accountable for the operational execution and the quality outcome across a portfolio of concurrent projects — many of them complex agentic-workflow evaluations.
Our commercial team wins the business. From the moment it is won, it is yours: you scope it, configure it, run it, defend its quality, and deliver it. You will be joining a small, early Delivery team, working closely with our ML Lead, annotator delivery team, commercial team, and product and engineering. Because the team is still young, you will help build and scale the delivery function itself — the playbooks, quality standards, and processes that everyone who follows you will run on — and you will have direct exposure to NewtonX’s C-level. This is a ground-floor seat in a business we expect to grow extremely quickly, with the career path that comes with it.
Location: Remote (US or Canada) or Hybrid (New York City)
Turn a training or evaluation objective into concrete task design, a defined quality bar (defect-rate and inter-annotator agreement targets), an annotator profile, and — for agentic projects — an environment and tool strategy.
Configure the project on the platform. Stand up the multi-layer quality pipeline, task forms, grading rubrics, annotator enablement, and routing.
Author the first-draft guidelines and gold set with the ML Lead, and pressure-test them before production starts. Own quality, throughput, and cost. Track how each project is performing against its targets, diagnose what is drifting, and act before it reaches the client.
Manage the annotator pool on your projects. Assignment, layer access, qualification, and performance — working with the annotator delivery team to get the right experts on the right tasks.
Run project channels and calibration sessions, handle exceptions and escalations, and adjust configuration as the work reveals what the spec missed.
Be the client’s point of contact throughout — scoping calls, mid-project updates, quality escalations, and delivery.
Manage expectations against scope, and diagnose acceptance issues candidly when they arise. Grow the account from the inside. Surface expansion opportunities and new use cases to the commercial team, and act as the technical subject matter expert on calls when new work is being scoped.
Run client acceptance testing against agreed criteria, capture sign-off, and trigger the commercial milestone.
Codify what works into playbooks, templates, and quality standards that the next Project Lead can run from day one.
You will be running on a platform that is still being built; 3+ years of experience in data labeling, RLHF/SFT, or AI evaluation delivery — you have shipped real annotation or evaluation projects at a data labeling company (Scale, Surge, Mercor, Snorkel, Handshake, Centific, Labelbox, SuperAnnotate, or similar) or inside an AI lab. we are not looking for a generalist project manager.
~ You are comfortable owning quality metrics, debugging a stalled queue, and rewriting a rubric that is not holding up in production.
~ You can run a scoping call with a technical buyer, deliver bad news without losing the room, and translate operational mechanics into terms a client cares about.
~ Data analysis skills using SQL or Python are a strong plus.
~ You will run several concurrent projects with different clients, quality bars, and annotator pools.
~ This role handles annotator personal data and client-confidential information under strict data-security and confidentiality standards; 150-240K total on target compensation + participation in our company stock buying program
~ Massive impact: the chance to help build a new business unit from the ground up with direct C-level influence at an extremely fast-growing late-stage startup
~ Fast-track career growth toward operational and commercial leadership
~ Excellent medical, dental, and vision insurance
~401k match with immediate vesting
~ Health savings/flexible savings account, and pre-tax commuter benefits
~ Paid time off: vacation, holidays, sick, and parental leave
~ A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success (happy hours, team projects, and retreats)
We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.
Our clients include Google, Microsoft, TikTok, DoorDash, Stripe, and Coinbase. NewtonX has raised $47M from investors including Two Sigma Ventures, Third Prime, XFund, and Citi Ventures.
NewtonX is turning the world’s largest verified expert network into the evaluation, post-training, and audit data that enterprises and AI labs need to deploy AI in production. We build high-quality, expert-generated datasets that train and evaluate frontier AI systems — spanning domain eval sprints, custom data solutions, model behavior audits, agentic RL environments, and domain QA-as-a-service.
We are hiring a Project Lead to own client engagements end to end, from scoping through delivery, on our data operations platform. You will be the client’s point of contact and the person accountable for the operational execution and the quality outcome across a portfolio of concurrent projects — many of them complex agentic-workflow evaluations.
Our commercial team wins the business. From the moment it is won, it is yours: you scope it, configure it, run it, defend its quality, and deliver it. You will be joining a small, early Delivery team, working closely with our ML Lead, annotator delivery team, commercial team, and product and engineering. Because the team is still young, you will help build and scale the delivery function itself — the playbooks, quality standards, and processes that everyone who follows you will run on — and you will have direct exposure to NewtonX’s C-level. This is a ground-floor seat in a business we expect to grow extremely quickly, with the career path that comes with it.
Location: Remote (US or Canada) or Hybrid (New York City)
Turn a training or evaluation objective into concrete task design, a defined quality bar (defect-rate and inter-annotator agreement targets), an annotator profile, and — for agentic projects — an environment and tool strategy.
Configure the project on the platform. Stand up the multi-layer quality pipeline, task forms, grading rubrics, annotator enablement, and routing.
Author the first-draft guidelines and gold set with the ML Lead, and pressure-test them before production starts. Own quality, throughput, and cost. Track how each project is performing against its targets, diagnose what is drifting, and act before it reaches the client.
Manage the annotator pool on your projects. Assignment, layer access, qualification, and performance — working with the annotator delivery team to get the right experts on the right tasks.
Run project channels and calibration sessions, handle exceptions and escalations, and adjust configuration as the work reveals what the spec missed.
Be the client’s point of contact throughout — scoping calls, mid-project updates, quality escalations, and delivery.
Manage expectations against scope, and diagnose acceptance issues candidly when they arise. Grow the account from the inside. Surface expansion opportunities and new use cases to the commercial team, and act as the technical subject matter expert on calls when new work is being scoped.
Run client acceptance testing against agreed criteria, capture sign-off, and trigger the commercial milestone.
Codify what works into playbooks, templates, and quality standards that the next Project Lead can run from day one.
You will be running on a platform that is still being built; 3+ years of experience in data labeling, RLHF/SFT, or AI evaluation delivery — you have shipped real annotation or evaluation projects at a data labeling company (Scale, Surge, Mercor, Snorkel, Handshake, Centific, Labelbox, SuperAnnotate, or similar) or inside an AI lab. we are not looking for a generalist project manager.
~ You are comfortable owning quality metrics, debugging a stalled queue, and rewriting a rubric that is not holding up in production.
~ You can run a scoping call with a technical buyer, deliver bad news without losing the room, and translate operational mechanics into terms a client cares about.
~ Data analysis skills using SQL or Python are a strong plus.
~ You will run several concurrent projects with different clients, quality bars, and annotator pools.
~ This role handles annotator personal data and client-confidential information under strict data-security and confidentiality standards; 150-240K total on target compensation + participation in our company stock buying program
~ Massive impact: the chance to help build a new business unit from the ground up with direct C-level influence at an extremely fast-growing late-stage startup
~ Fast-track career growth toward operational and commercial leadership
~ Excellent medical, dental, and vision insurance
~401k match with immediate vesting
~ Health savings/flexible savings account, and pre-tax commuter benefits
~ Paid time off: vacation, holidays, sick, and parental leave
~ A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success (happy hours, team projects, and retreats)
We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.
Remote Project Lead, AI Model Training in remote at Unknown Company
This position is listed as full time and able to be worked remotely.