Senior software engineers evaluate and improve coding agents by applying their engineering judgment to real software tasks and codebases they know well.
Role OverviewYou will help frontier AI labs identify where coding models fail, evaluate their work, and provide corrections that inform future model training. No AI background is required, your software engineering expertise is the core qualification.
Key Responsibilities- Assign AI agents real engineering tickets and review their output as you would a teammate’s pull request.
- Run and evaluate agent-produced code.
- Work through real problems in familiar codebases alongside an AI agent, step by step, and identify where its reasoning or implementation goes wrong.
- Share feedback on model failures and quality standards directly with project leads.
- At least 4 years of professional software engineering experience.
- Bachelor’s or Master’s degree in computer science or a related field.
- Strong written English skills.
- Ability to commit 40 hours per week during the contract.
- Remote, independent contract engagement with a 40-hour weekly commitment.
- Set your own working hours.
- Dedicated support, timely answers, and feedback on completed work.
- Up to $150/hr (depending on the project).
- Weekly pay of $6,000 for a 40-hour week.
- Additional approved hours are paid at $150/hr.
- Earn $100 for passing the proctored coding assessment, which takes about 2 hours.
- Earn $40 upon submitting the first stage of a paid trial task and $1,100 after the task is approved through all review cycles, about 10 hours total.
- US work authorization is required.
- The proctored coding assessment must be completed without AI tools.
- Create an account and complete identity verification.
- Pass the proctored coding assessment.
- Complete the paid trial task.
- On successful completion, onboard to relevant projects and begin work.
Senior Software Engineer, AI Data in Ft. Worth at Unknown Company
This position is listed as contract and able to be worked remotely.