Position: Software Engineering, Data Science, and Systems Design Experts, Swift (5+ YOE)
Type: Hourly contract
Compensation: $60–$100/hour
Location: Remote
Commitment: Full-time or part-time, flexible based on project work
Role Responsibilities
- Evaluate AI-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness
- Perform fact-checking using reliable public sources and references
- Execute code to validate correctness and test outputs
- Annotate responses by identifying strengths, issues, and inaccuracies
- Assess code quality, readability, and algorithmic soundness
- Ensure responses align with best practices and expected system behavior
- Follow structured evaluation guidelines, benchmarks, and taxonomies
Requirements
- Strong experience in software engineering or related technical roles
- Strong expertise in Swift
- Ability to solve medium to hard coding problems independently
- Strong experience contributing to open-source projects
- Strong experience using LLMs for coding and understanding their limitations
- Strong attention to detail in evaluating technical reasoning and identifying issues
- Strong written communication skills for clear technical feedback
- Degree in Computer Science or related field
iOS / Swift Developer (AI Model Evaluation & Code Quality) | Remote in Remote at Unknown Company
This position is listed as part time and able to be worked remotely.