Software Engineer for AI Training and Evaluation

Apply production software engineering judgment to help evaluate advanced AI systems. Your expertise will inform the standards used to assess AI-generated engineering work.

This is an ongoing talent pool for AI training and evaluation projects, not a specific active opening. Projects may begin on short notice, and qualified engineers are contacted when a project aligns with their technical background.

• Create engineering problems based on systems you have shipped, including requirements, constraints, failure modes, and reference answers used to evaluate model responses.
• Review AI-generated code and designs for edge cases, appropriate complexity, and whether tests validate the behavior they claim to cover.
• Identify code that may pass review but fail in production because of concurrency, scale, error handling, or operating costs.
• Understand that this listing itself does not make acceptance or rejection decisions. Project-specific hiring decisions occur when you are invited to a matching engagement.

• Professional experience building and shipping software.
• Strong written communication skills for explaining technical reasoning.
• Comfort working through ambiguous tasks and identifying unclear instructions.
• Experience owning production code and addressing its real-world behavior.

• Frontend development, including React, TypeScript, and Next.js; backend development, including Java, Go, and Node.js; and full-stack engineering.
• Mobile development for Android and iOS, embedded systems, and IoT.
• DevOps, platform, systems, performance, QA, automation, and security engineering.

• Remote, hourly engagements.
• Project invitations specify the rate, hours, client, and other engagement details.
• Matching may occur within a week or take several months, depending on available client projects and your specialty.

Compensation typically ranges from $70 to $150 per hour, with project rates set according to scope and depth.

Complete registration once to remain eligible for all qualified expert networks and potential matching projects.

• Submit your resume and confirm your work location.
• Complete a short AI interview, approximately 20 minutes.
• Your background is verified before you are added to the software engineering talent pool.
• Completing the domain-expert interview and joining each network you qualify for can improve your likelihood of being matched.