This job involves checking whether code produced by AI models correctly solves a given software engineering prompt, and whether the accompanying tests really verify that behavior. It is aimed at experienced software engineers who can judge problem definitions and test suites with strict technical standards.
Pay not disclosed
The platform does not publish the pay for this job.
The platform has not published which countries are eligible for this job.
You apply on Vetto's job board: answer the application questions for the project. If selected, Vetto invites you to work on its tasks.
Official posting: https://job-boards.greenhouse.io/vetto/jobs/4112754009
Last checked on October 8, 2026.
This role involves writing, debugging, and evaluating AI-generated code to help train and improve AI coding assistants. Software engineers will review code quality, identify bugs and security issues, provide detailed feedback, and design test scenarios to stress-test AI capabilities across various programming languages and frameworks.
This remote contract role asks senior full-stack engineers to assess AI-generated code across frontend and backend, judging correctness, quality, and security. It also involves building internal tooling for data annotation and reviewing system designs. It suits experienced engineers who can give precise written feedback that helps AI models write better code.
You will contribute to training next-generation AI models by creating realistic coding tasks and implementing deterministic verifiers. This flexible contracting role is aimed at experienced backend engineers capable of generating relevant technical challenges and automatically evaluating solutions.
Posted October 6, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
You will help train AI models by creating realistic programming tasks and deterministic validators. This flexible contractor role will allow you to leverage your backend development experience to design relevant challenges for AI to solve.
Posted October 3, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
This role involves evaluating the quality, correctness, and reproducibility of software engineering tasks used to train and test the AI models of a leading laboratory. You audit tasks at the repository level, baseline patches, test harnesses, and scoring system integrity, providing structured feedback based on an evaluation grid.
Posted August 28, 2026
You will build and refine evaluations to test the performance of frontier code models by transforming pull requests into engineering tasks. You will use a proprietary evaluation framework to validate how coding agents solve complex problems, identifying real weaknesses in their implementations. This role is for software engineers with solid fundamentals, capable of navigating substantial codebases and producing rigorous evaluations.
Posted June 2, 2025
