Contract Spy
Remote
About the job
About Surge AI
Surge AI partners with the world's leading AI labs to build the benchmarks and RL environments that train and evaluate frontier models. Most benchmarks cut corners because expert humans are expensive. Our model is the opposite: we pay experts enough that we don't have to.
Position: Senior Software Engineer (Agentic Coding RL Environments)
Type: Contract
Compensation: $100–150+/hour ($200–300k+/year). Rates scale with your experience, and many go past the top of that range.
Location: Fully remote, any time zone
Role Responsibilities
•Build coding RL environments and benchmarks that test how agents perform on realistic software engineering tasks
•Design tasks based on real engineering work
•Review and red-team model output to surface meaningful failures
•Write the tests, rubrics, and success criteria that separate good work from slop
•Give...