Working remotely on a part-time freelance basis, a Senior Python Engineer will create and evaluate tasks for AI coding agents, building realistic developer environments and designing evaluation criteria to assess agent performance. Key responsibilities Build realistic developer environments that simulate a virtual company with a codebase and context Design tasks and evaluation criteria to ensure AI agents can effectively solve developer challenges Write and iterate on tests that verify agent solutions, refining them based on quality assurance feedback Required qualifications 8+ years of experience in software development Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis Experience in writing functional and integration tests English proficiency at a B2 level or higher