Contract Spy
Remote (United Kingdom)
Position : Coding Agent Evaluation Specialist (LLM Eval & AI Training)
Employment Type : Remote Freelance
Working Hour : Flexible
About the Opportunity
We are building a talent pool of qualified professionals for upcoming and future Coding Agent Evaluation and AI Training projects. This freelance, fully remote opportunity is ideal for software engineers, programmers, and coding professionals who are passionate about improving the quality, safety, and performance of Large Language Models (LLMs) and AI coding agents.
In this role, you will evaluate AI-generated code, assess coding agent performance, identify errors, and provide structured feedback that helps train and improve next-generation AI systems.
Job Responsibilities
· Apply and adapt coding evaluation rubrics to assess LLM-generated code responses and coding agent trajectories, including correctness, code quality, efficiency,...