QA Specialist – AI Chatbot Response Evaluations (R Programming) at SuperAnnotate, EMEA Remote, £Freelance Rate

Role Overview:

We are looking for a QA Specialist with strong expertise in R programming to review and audit Data Annotator evaluations of AI-generated responses. This role involves validating the accuracy of code assessments, checking for statistical and data analysis correctness, and ensuring all proof-of-work code is properly tested and documented.

Responsibilities:

• Audit annotator evaluations of AI-generated R code and data analysis tasks.
• Verify correct application of rating rubrics for instruction-following and factual accuracy.
• Test annotator-submitted R code to confirm functionality, reproducibility, and statistical correctness.
• Identify any flaws in annotator reasoning, missed code issues, or incorrect ratings.
• Deliver clear, actionable feedback to improve annotator evaluation quality.
• Collaborate with QA leads to maintain alignment with guidelines and quality standards.

Required Qualifications:

• 5–7+ years of experience in R programming, statistical analysis, or data science QA.
• Proficient in core R syntax, data manipulation (dplyr, tidyverse), visualization (ggplot2), and modeling.
• Experience validating code logic, reproducibility, and statistical integrity.
• Ability to assess instructional adherence and provide constructive written feedback.
• English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

• Experience with annotation QA or evaluating AI-generated data science content.
• Familiarity with model evaluation workflows, LLM responses, or RLHF processes.
• Background in academic or applied statistical research is a plus.

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#RStats #QA #AI #DataScience #CodeReview #RemoteJobs #RProgramming #StatisticalAnalysis