SC Cleared Automation Tester (AI/LLM Testing) at RedRock Consulting, England, £Competitive Day Rate

SC Cleared Automation Tester (AI / LLM Testing)

Location: UK Based

Clearance: Active SC Clearance Required

Rate: Competitive Day Rate

We're supporting a major digital transformation programme and are looking for an SC Cleared Automation Tester with a passion for quality engineering and emerging AI technologies.

This is a fantastic opportunity to join a highly skilled delivery team working on innovative solutions that incorporate Artificial Intelligence, Large Language Models (LLMs) and advanced automation practices.

The Role

You'll play a key role in shaping the testing strategy from day one, ensuring quality is embedded throughout the development lifecycle. Working closely with developers, architects and stakeholders, you'll help build robust automated testing into CI/CD pipelines while validating both traditional software components and AI-driven capabilities.

Key responsibilities include:

• Defining and implementing the overall test strategy and approach
• Building automated testing into CI/CD pipelines
• Creating and maintaining automated test frameworks using Python
• Designing and executing integration, regression and end-to-end testing
• Validating AI and LLM-based outputs for quality, consistency and reliability
• Developing repeatable test harnesses and test datasets
• Managing defects and supporting release activities
• Producing clear, traceable and auditable test evidence
• Supporting assurance activities and user acceptance testing
• Collaborating within Agile delivery teams throughout each sprint

Required Experience

• Proven background in Automation Testing or Quality Engineering
• Strong Python test automation experience
• Experience with Playwright, Selenium, PyTest or similar frameworks
• CI/CD pipeline experience (Azure DevOps, GitHub Actions, Jenkins or similar)
• Integration, API and regression testing experience
• Strong understanding of Agile delivery environments
• Experience working within secure, regulated or government environments
• Active SC Clearance

Highly Desirable

• Experience testing AI, Machine Learning, LLM or Generative AI solutions
• Experience with RAG (Retrieval Augmented Generation) applications
• AI evaluation, prompt testing or model validation experience
• Synthetic test data creation and management
• Cloud platform experience (AWS or Azure)