Role Overview
Build reinforcement learning environments that evaluate an AI model’s ability to solve complex software engineering problems using Model Context Protocol tools. You will create real-world tasks and evaluation materials that help improve how AI systems learn, reason, and perform. Prior AI experience is not required.
Key Responsibilities
- Create software engineering tasks involving bug fixes, feature implementation, codebase refactoring, and performance optimization.
- Design reproducible environments, deterministic verification methods, and golden reference solutions.
- Develop evaluations that measure both MCP tool use and software engineering ability, including agents’ ability to discover and reason over information from real MCP servers.
- Provide high-quality, detail-oriented written input that supports model training and evaluation.
Qualifications
- Proficiency in C++, Python, Java, Go, TypeScript, or Rust.
- Strong understanding of algorithms, data structures, and performance tuning.
- Experience debugging complex software issues and delivering maintainable solutions.
- Background in feature development, codebase refactoring, performance optimization, and scalable software design.
- Excellent written and verbal communication skills, attention to detail, and experience collaborating on cross-functional teams, ideally in remote settings.
- Experience with large-scale distributed codebases, rigorous code reviews, and software best practices is preferred.
- Familiarity with modern AI or machine learning systems is helpful but not required.
Work Terms
- Remote independent contractor engagement.
- Approximately 15 hours per week.
- Flexible schedule, with freedom to choose your working hours and days, including weekends.
- Minimum weekly task-submission requirements apply.
- Roles are typically filled within 48 hours. Selected candidates should be ready to begin initial tasks within 24 to 48 hours after completing onboarding.
Compensation
- Advertised pay range: $60 to $120 per hour.
- Compensation is output-based and paid per task that meets project specifications. Completion time may vary based on experience and workflow.
Application Process
- Submit an application and answer screening questions.
- Complete an approximately 30-minute AI interview.
- Complete a technical assessment, if requested.
- Proceed to hiring-manager review.
AI Engineer in Warren at Unknown Company
This position is listed as contract and able to be worked remotely.