QA Engineer – AI Chatbot Response Evaluations (Multiple Programming Languages) at SuperAnnotate, EMEA Remote, £Contract Rate

Role Overview:

We are hiring experienced QA Engineer across a wide range of programming and scripting languages to audit the work of Data Annotators evaluating AI-generated code. You will assess whether annotators have accurately followed instruction rubrics, tested functionality, and delivered valid proof-of-work. Each QA Specialist will focus on one or more specific languages depending on expertise.

We are hiring for the following languages:

• Java
• C++
• HTML/CSS
• C#
• TypeScript
• Bash
• PHP
• R
• Dart
• Excel (advanced formulas and data analysis)
• Kotlin
• C
• MATLAB

Responsibilities:

• Review and audit evaluations of AI-generated code specific to your area of expertise.
• Verify annotator compliance with instruction-following and factual correctness guidelines.
• Test code snippets for functionality, performance, safety, and formatting.
• Evaluate annotator-submitted proof-of-work and validate reasoning.
• Identify logical flaws, missed edge cases, or incorrect scoring.
• Provide structured, constructive feedback to annotators.
• Collaborate with QA leads and contribute to guideline refinement.

Required Qualifications:

• 7+ years of professional experience in at least one of the listed languages.
• Deep understanding of language-specific syntax, best practices, and testing methodologies.
• Ability to debug, validate, and explain code clearly.
• Experience with code review or QA processes.
• Strong documentation and feedback skills.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

• Experience with annotation QA or model evaluation workflows.
• Familiarity with AI-generated code, prompt-based evaluations, or RLHF pipelines.
• Background in software development, data science, or systems engineering.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of a dynamic team driving innovation in AI and software engineering. As a QA Specialist, your technical expertise will play a critical role in enhancing the accuracy, safety, and instructional quality of AI-generated code across a wide range of programming languages. This is a fully remote opportunity offering flexible working hours, a milestone-based structure, and competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#QA #AI #CodeReview #RemoteJobs #TechHiring #Freelance #LLM #SoftwareTesting #Programming