Contract Spy
Hybrid (UK)
Job title: AI QA Engineer
Type: Full-time Contract (until September)
Location: UK-based applicants only. You must live within 30 miles of one of our five UK offices: Edinburgh, Newcastle, Leeds, Manchester or London
Working pattern: Flexible (remote, hybrid, or in-office) The role
We're looking for an AI QA Engineer to work across product quality, AI behaviour evaluation, and defect investigation.
This is not a traditional QA role focused purely on scripted testing or automation. A key part of the role involves reviewing AI agent conversations and assessing whether responses were accurate, appropriate, and aligned to the expected customer experience. Because AI behaviour is not always deterministic, strong judgement, attention to detail, and communication skills are essential.
You'll support release testing and regression prevention across the platform, carrying out structured manual QA across key journeys during release cycles to improve release...