AI Evaluation AI training jobs

CAD Expert

• Engineering
• Platform: micro1
• Location: 58 countries

This role involves training AI models by leveraging your expertise in CAD. You will evaluate content generated by AI in manufacturing workflows, provide detailed feedback on manufacturing processes, and develop evaluation frameworks to measure accuracy and efficiency. The role requires strong programming skills, particularly with Python and coding agents.

Posted September 3, 2026

Machine Learning Engineers: Scenario Building for Reinforcement Learning

• Data & Machine Learning
• Platform: Terac
• Location: United States

This study invites machine learning engineers and AI researchers to build test scenarios on a remote reinforcement learning platform. Participants set environmental parameters, define spatial constraints and agent interaction rules, run preliminary agent tests, and then share usability feedback in an interview. It is aimed at people with hands-on experience in simulation design and RL environments.

Posted September 3, 2026

AI Tutor - Design

• Writing, Creative & Design
• Platform: xAI

This role asks a design specialist to evaluate and improve design work across graphic, interface, web and game formats, so that an AI model learns to tell clear, functional design from attractive but weak work. The person writes precise critiques, labels datasets, and creates strong reference examples when existing work falls short. It suits designers with a proven portfolio who can judge quality beyond their own specialty and explain their reasoning clearly in English.

Posted September 3, 2026

AI Tutor - Humanities

• Science & Research
• Platform: xAI

This role asks a humanities scholar to judge and improve how an AI model handles questions in linguistics, history, classical studies, literature, philosophy, ethics, and the arts. The work centers on checking the model's answers against primary sources, flagging errors and unsupported claims, and writing reference answers that separate evidence from interpretation and speculation. It suits candidates with deep scholarly training who write precise, carefully calibrated analysis.

Posted September 3, 2026

Multilingual Inpatient Hospitalist (MD) - Clinical Documentation & AI Evaluation

• Health & Medicine
• Platform: Mercor
• Location: United States
• Language: Spanish, Chinese, Filipino, Russian, Haitian Creole
• Level: Intermediate

This role is for practicing inpatient hospitalist physicians to evaluate and annotate clinical documentation generated by medical AI systems. You will review patient records, identify gaps and inaccuracies in notes produced by AI, and provide structured feedback to engineering teams. The role requires advanced proficiency in at least one language other than English.

Posted September 2, 2026

Multilingual Primary Care Physician (MD) - Clinical Documentation & AI Evaluation

• Health & Medicine
• Platform: Mercor
• Location: United States
• Language: Spanish, Chinese, Filipino, Russian, Haitian Creole
• Level: Intermediate

You are a general practitioner or internist currently practicing in an outpatient setting and proficient in English plus another language at an advanced level. You annotate and evaluate clinical notes generated by AI, flagging omissions and inaccuracies to improve clinical decision support tools. This remote and part-time role allows you to leverage your expertise in medical documentation with a specialized AI health product team.

Posted September 2, 2026

Music & Sound Annotation Expert

• Writing, Creative & Design
• Platform: micro1
• Location: 58 countries
• Level: Intermediate

This role involves annotating and analyzing short audio recordings by documenting precisely the instruments, tempo, tonality and ambient sounds perceived. It is aimed at musicians, producers or sound engineers with proven practical experience and excellent analytical listening ability to identify details in complex sound environments.

Posted September 2, 2026

AI Evaluators: Assessing A Shopping Assistant

• Data & Machine Learning
• Platform: Terac
• Location: United States

This project asks evaluators to examine how a digital shopping assistant answers real e-commerce questions and to locate where its reasoning or product suggestions fall short. The work is remote and ongoing, and it is aimed at people with quality assurance, data evaluation, or e-commerce backgrounds who can build structured evaluation frameworks.

Posted September 2, 2026

Pediatric Inpatient Nurses (RN)

• Health & Medicine
• Platform: Mercor
• Location: United States

This role is for experienced pediatric nurses with acute care expertise. You will evaluate outputs generated by AI systems from real clinical documentation, annotate pediatric nursing assessment data, and provide expert feedback to improve the reliability and safety of medical AI tools. The role combines your field experience in pediatrics with a direct contribution to developing clinically robust algorithms.

Posted September 1, 2026

Adolescent/Child Safeguarding & Exploitation Specialist

• Health & Medicine
• Platform: micro1
• Location: 58 countries
• Level: Intermediate

This role involves assessing risks of exploitation and sexual abuse in adolescents by analyzing complex cases to improve AI systems training. You will apply your expertise in child protection to produce clear recommendations grounded in recognized safeguarding frameworks, taking into account developmental factors and trauma. This position is aimed at experienced clinical professionals working in child protection or adolescent mental health.

Posted September 1, 2026

STEM Expert

• Science & Research
• Platform: micro1
• Location: 58 countries

You will contribute to an AI training project by solving, validating, and commenting on complex problems in your scientific field of expertise. The role combines rigorous scientific analysis, Python programming for calculations and simulations, and critical evaluation of solutions generated by AI.

Posted September 1, 2026

Drug Discovery Scientist

• Science & Research
• Platform: Mercor
• Location: United States

This role involves designing realistic evaluation challenges for AI models applied to drug discovery. As an expert in chemistry and molecular biology, you will build complex research scenarios based on real and ambiguous data, where AI must demonstrate genuine reasoning capability rather than simple pattern association. You will be responsible for the entire process: challenge design, data corpus assembly, response evaluation, and iterative revision.

Posted August 31, 2026

Engineering Simulation Specialist

• Engineering
• Platform: Mercor
• Location: United States

This evaluation role involves designing simulations and technical specifications to test the ability of advanced AI models to reason from first principles in your area of expertise in engineering. You will define complex design problems (controllers, circuits, geometries) that the AI must solve by demonstrating reasoning capability rather than simple data retrieval.

Posted August 31, 2026

AI Developer Trace Task Auditor

• Software Engineering
• Platform: Mercor
• Location: United States
• Level: Intermediate

You will evaluate the quality and correctness of AI-assisted software development traces used to train and assess models at a leading AI laboratory. You must judge the accuracy of coding sessions, the consistency of workflows, and the quality of reasoning, then provide structured written feedback according to an evaluation grid.

Posted August 28, 2026

Kubernetes Task Auditor

• Software Engineering
• Platform: Mercor
• Location: United States
• Level: Intermediate

This job involves evaluating the quality and compliance of Kubernetes scenarios for AI model training. You will analyze manifests, diagnose cluster failures, and provide structured feedback according to an evaluation grid, as a DevOps expert or platform engineer.

Posted August 28, 2026

Life & Annuity Specialist

• Finance & Accounting
• Platform: Mercor
• Location: United States
• Level: Intermediate

This role involves designing realistic scenarios for life insurance and annuity advice and underwriting, then evaluating an AI model's responses against industry standards. You must have solid professional experience in life insurance or investment advisory, and be able to provide detailed feedback to improve the AI's reasoning on mortality risk and product suitability.

Posted August 28, 2026

ML Challenge Task Auditor

• Data & Machine Learning
• Platform: Mercor
• Location: United States
• Level: Intermediate

You will evaluate the methodological quality and scientific rigor of machine learning tasks designed to train and test models at a cutting-edge AI laboratory. You will provide structured feedback on experimental design, model selection and evaluation protocols, critiquing claims against observed results.

Posted August 28, 2026

SWE-Bench Task Auditor

• Software Engineering
• Platform: Mercor
• Location: United States
• Level: Intermediate

This role involves evaluating the quality, correctness, and reproducibility of software engineering tasks used to train and test the AI models of a leading laboratory. You audit tasks at the repository level, baseline patches, test harnesses, and scoring system integrity, providing structured feedback based on an evaluation grid.

Posted August 28, 2026

Investment Banking Associate

• Finance & Accounting
• Platform: micro1
• Location: 58 countries
• Level: Intermediate

This job involves contributing to the creation of high-quality datasets for AI model training, leveraging expertise in investment banking. You will design and refine tasks simulating real investment banking activities such as pitch book construction, valuation analysis, and comparable transaction review. Your financial expertise domain is essential for AI systems to learn to reason and perform on authentic, professionally-quality content.

Posted August 27, 2026

Investment & Finance Expert

• Finance & Accounting
• Platform: micro1
• Location: 58 countries
• Level: Entry level

You will evaluate and improve the ability of AI models to reason about complex financial questions, particularly in valuation, financial modeling, and real-world investment scenarios. You will create prompts and reference responses based on your operational experience, while flagging errors and reasoning weaknesses in the model.

Posted August 27, 2026