6 qa software engineer jobs found

hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions. This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems. About the Project This evaluation dataset is code question and answer data. This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements) Key Responsibilities Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis,...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation isproject-based, not permanent employment. What this opportunity involves You'll create challenging coding test cases that push AI coding systems to their limits: Review and refine realistic coding tasks based on provided production codebases with realistic scope, requirements and information sources Write comprehensive functional tests that validate actual end-to-end behavior and edge-cases, not just superficial checks Craft "fair but hard " challenges where the AI has all the context it needs, but has to work for it (information scattered across files and external sources, complex reasoning required) Analyze AI failures to understand what the model struggles with vs. what it masters Iterate based on feedback...

SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position (short-term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active security clearance   The Law Enforcement Cloud Platform (LECP) is the Home Office 's strategic cloud hosting solution for national law enforcement applications and products (LECP 's 'tenants '). LECP provides a secure, police-assured environment based on a common infrastructure design. By enabling access to shared services and tooling, LECP offers a cost-effective cloud solution, particularly for those needing to build new services or migrate away from existing hosting arrangements which no longer fulfil their requirements or align with organisational strategy....

Location: Remote (must have access to a physical Mac) Fluent Language Skills Required: English Why This Role Exists Supporting a high-priority data collection initiative aimed at improving how AI systems understand complex software interfaces and real-world, multi-step workflows. Current datasets lack the fidelity and expert grounding needed to reflect authentic professional software usage. This project addresses that gap by collecting high-quality screen annotations and screen recordings performed by experienced domain experts working in real digital environments. What You’ll Do Depending on the task phase, you may be asked to complete one or both of the following: Record screen sessions demonstrating specific tasks, accompanied by clear verbal narration explaining each step Annotate screenshots of professional software by drawing precise bounding boxes around relevant UI elements Follow provided staging...

Location: Remote (must have access to a physical Mac) Fluent Language Skills Required: English Why This Role Exists Supporting a high-priority data collection initiative aimed at improving how AI systems understand complex software interfaces and real-world, multi-step workflows. Current datasets lack the fidelity and expert grounding needed to reflect authentic professional software usage. This project addresses that gap by collecting high-quality screen annotations and screen recordings performed by experienced domain experts working in real digital environments. What You’ll Do Depending on the task phase, you may be asked to complete one or both of the following: Record screen sessions demonstrating specific tasks, accompanied by clear verbal narration explaining each step Annotate screenshots of professional software by drawing precise bounding boxes around relevant UI elements Follow provided staging...

Location: Remote (must have access to a physical Mac) Fluent Language Skills Required: English Why This Role Exists Supporting a high-priority data collection initiative aimed at improving how AI systems understand complex software interfaces and real-world, multi-step workflows. Current datasets lack the fidelity and expert grounding needed to reflect authentic professional software usage. This project addresses that gap by collecting high-quality screen annotations and screen recordings performed by experienced domain experts working in real digital environments. What You’ll Do Depending on the task phase, you may be asked to complete one or both of the following: Record screen sessions demonstrating specific tasks, accompanied by clear verbal narration explaining each step Annotate screenshots of professional software by drawing precise bounding boxes around relevant UI elements Follow provided staging...