1234 open jobs
Open roles in AI training, model evaluation, RLHF and data labeling for domain experts. Search, filter, then apply directly on Mercor, micro1, Turing, Ethos, Mindrift, DataAnnotation, Alignerr, Handshake AI, Surge AI, xAI, Vetto or Terac.
This role involves evaluating how well AI models can perform computational biology tasks. Computational biologists and bioinformaticians will design realistic analysis scenarios from their own work, run them through AI systems, and grade the results against professional standards to help benchmark model capabilities.
As a Data Scientist, you will evaluate analyses generated by AI models on real datasets, checking whether the statistical methods and conclusions are sound. You will identify flaws in the reasoning, stress-test the logic, and write detailed assessments that serve as training data for future model improvements.
As a Machine Learning Engineer, you will evaluate and improve how AI models reason about machine learning systems, including training dynamics, evaluation design, and deployment strategies. You will write prompts to test model reasoning, identify subtle errors in AI outputs, and provide correct solutions based on real practitioner experience.
This role involves creating rigorous mechanical engineering problems and solutions to train AI models to reason like practicing engineers. You will write verifiable problems from your specialty, derive correct answers, test them against AI systems, and review AI-generated engineering work for real-world applicability.
A mechanical designer writes rigorous engineering problems and solutions to train AI models to reason like practicing engineers. You'll create challenging, closed-ended technical problems from your specialty, verify correct answers, test them against AI systems, and review AI-generated engineering work for real-world applicability.
A mechanical engineer will create challenging, closed-ended engineering problems based on their specialty, derive correct solutions, and evaluate how well AI models perform on real-world engineering tasks. The role involves writing problems that test genuine engineering reasoning, component sizing, failure analysis, CAD interpretation, design impact prediction, and assessing AI-generated analysis and designs for correctness and practical applicability.
A Senior Mechanical Design Engineer will create rigorous engineering problems and solutions to evaluate and improve AI model reasoning across mechanical specialties. You will write closed-ended technical challenges from your expertise, derive correct answers, test them against AI systems, and review AI-generated engineering work for real-world accuracy and applicability.
You will evaluate AI-generated code by running models on real engineering tasks, analyzing their output against production standards, and stress-testing them to find failures. This role is ideal for experienced software engineers who want to contribute to AI model improvement through rigorous code review and red-teaming.
A Validation Engineer writes challenging mechanical engineering problems from their specialty, solves them, and evaluates how well AI systems perform on real engineering reasoning tasks. The role focuses on creating benchmarks that measure whether AI can do actual engineering work like component sizing, failure mode identification, and design change prediction.
ML expert for the evaluation and training of AI models on machine learning tasks and data pipelines (ETL).
Referral link to micro1's job list: search for this role there. Open this exact job
Expert data engineering for evaluating data engineering tasks (SQL, ETL, data processing) performed by AI models.
Referral link to micro1's job list: search for this role there. Open this exact job
Expert data scientist for the evaluation of statistical work, modeling, and experimentation performed by AI models.
Referral link to micro1's job list: search for this role there. Open this exact job
This full-time role involves building, running and improving highly available cloud infrastructure, mainly on AWS and Kubernetes, for complex enterprise production systems. It suits experienced infrastructure, SRE, DevOps or platform engineers who can debug incidents, build observability with tools like Datadog, and work closely with software teams.
Posted October 7, 2026
This is a paid evaluation role for database engineers who will design realistic tasks that test how well AI agents handle database work. Each task is a self-contained problem with a reproducible environment, a working reference solution, tests, and grading criteria that separate robust engineering from code that only looks correct. It is aimed at experts with deep database-engine internals experience, not at DBA, SQL analytics, or ETL-only profiles.
Posted October 6, 2026
You will contribute to training next-generation AI models by creating realistic coding tasks and implementing deterministic verifiers. This flexible contracting role is aimed at experienced backend engineers capable of generating relevant technical challenges and automatically evaluating solutions.
Posted October 6, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
This role involves training and evaluating AI agents on fluid simulation tasks by setting up CFD simulations, creating reference solutions, and validating agent outputs. It is designed for experienced mechanical or aerospace engineers with strong computational fluid dynamics expertise.
Posted October 6, 2026
This role involves training and evaluating AI agents on expert-level computational fluid dynamics tasks. You will set up and run simulations using industry-standard CFD tools, create verified reference solutions, and develop Python validation checks to assess agent performance on fluid simulation problems.
Posted October 6, 2026
This role involves training and evaluating AI agents that perform mechanical engineering tasks within a CAD environment. You will design part geometry, create reference solutions, and assess how well the AI completes complex engineering work that would normally take an expert many hours.
Posted October 5, 2026
This freelance role involves training and evaluating AI agents to perform complex CAD design tasks in professional engineering software environments. You will create part geometry, develop reference solutions, and assess AI agent performance on projects that would typically require 10-15 hours of expert work.
Posted October 5, 2026
Design and optimization of deep learning systems, statistical analysis and training of ML models for Turing clients, remote work with time overlap with US time zones.
FAQ
AI training, model evaluation, RLHF, red teaming, data labeling and expert review roles, in fields from software and data science to medicine, law, finance, languages and science.
They are done online. Some are limited to residents of certain countries: when the platform publishes that restriction, the listing shows it.
Usually not. Most roles ask for professional experience in your own field. Each listing states the experience the platform requires.
By the hour or by the task, by the platform that hires you. We show the pay only when the platform publishes it. It is not a guarantee of income or hours.
Apply now opens the official posting on Mercor, micro1, Turing, Ethos, Mindrift, DataAnnotation, Alignerr, Handshake AI, Surge AI, xAI, Vetto or Terac, where you complete the application. You need no account here. See how it works.
