To support a research initiative on AI evaluation tasks, remote software engineers will review and assess programming challenges and evaluation harnesses, providing feedback on their technical accuracy and realism in a contract role. Key responsibilities Review and assess the quality of realistic programming tasks Evaluate coding environments and technical harnesses for AI testing Identify potential flaws in provided code structures and provide feedback Required qualifications Professional experience as a software engineer or developer Familiarity with building or verifying programming tasks Experience with code review and evaluation harnesses Comfortable discussing technical architecture and testing methodologies
Software Engineer for AI Evaluation in workfromhome at Unknown Company
This position is listed as contract and able to be worked remotely.