AI Evaluation AI training jobs

Developmental Psychology (PhD)

• Health & Medicine
• Platform: micro1
• Location: 58 countries
• Language: Japanese, French, Filipino, Malay, Lithuanian

This role invites developmental psychologists to contribute to the training of AI systems by applying your academic and clinical expertise. You will evaluate and annotate data related to child development, provide critical analyses on their psychological and cultural relevance, and collaborate with interdisciplinary teams to ensure the psychological integrity of AI models.

Posted September 10, 2026

Robot Training Operator

• Engineering
• Platform: micro1
• Location: 58 countries

This role involves operating a portable robotic manipulator arm in a laboratory to perform repetitive manipulation tasks for training robotic artificial intelligence models. You will execute precise instructions, reset environments between attempts, and report any technical issues to the project lead. No prior artificial intelligence experience is required.

Posted September 10, 2026

Shopify Specialist

• Business, Consulting & Operations
• Platform: micro1
• Location: 58 countries
• Level: Expert

You leverage your deep expertise in Shopify to evaluate and improve training scenarios for AI systems. You examine e-commerce task structures, identify gaps with real workflows, and provide detailed feedback to ensure training content is realistic and complete.

Posted September 10, 2026

Dermatologists: Evaluation of AI Diagnostic Outputs

• Health & Medicine
• Platform: Terac
• Location: United States

This paid study asks practicing dermatologists to judge how well AI diagnostic tools perform on skin images and clinical records. Participants review de-identified cases and check the automated findings against established reference standards. It suits clinicians who routinely diagnose skin conditions and can assess how reliable generated diagnoses are.

Posted September 10, 2026

Chemicals Safety for Redteaming

• Science & Research
• Platform: Mercor
• Location: United States

You are a chemistry expert with practical experience in synthesis, analytical chemistry, or chemical safety. You participate in evaluating AI models by writing calibrated test prompts across three risk levels, then assessing model responses against an established safety framework. This role requires both advanced technical expertise and the ability to document your judgments in an accessible way.

Posted September 9, 2026

Energetic Materials Expert for Redteaming

• Science & Research
• Platform: Mercor
• Location: United States

This role involves evaluating an AI model's responses to requests involving energetic materials and explosives, distinguishing between legitimate questions and dangerous requests. You will write progressively more complex test prompts, assess the model's responses against a defined safety policy, and provide written justification for your technical judgments. This role is intended for experts in materials chemistry specializing in propulsion and initiation systems, with solid practical experience in the field.

Posted September 9, 2026

Nuclear Engineering & Safeguards Experts for Red Team

• Science & Research
• Platform: Mercor
• Location: United States

Mercor is looking for nuclear engineering and nuclear safeguards experts to test the capabilities of frontier AI models to assess diversion risk. You will write complex prompts in your field, evaluate responses against a defined policy, and provide written technical justifications. This role requires deep expertise in fuel cycle or non-proliferation, and demonstrated ability to communicate technical issues with clarity.

Posted September 9, 2026

Radiologicals Safety for Redteaming

• Health & Medicine
• Platform: Mercor
• Location: United States

Mercor is recruiting radiological safety experts to test the robustness of AI models against dual-use requests. You will write progressively complex prompts, evaluate model responses according to a defined policy, and document reference responses with technical justifications. This role requires deep expertise capable of distinguishing legitimate professional questions from potentially dangerous requests.

Posted September 9, 2026

Data Analyst

• Data & Machine Learning
• Platform: micro1
• Location: 58 countries

This role invites experienced data analysts to examine and validate large business datasets to contribute to the training of AI systems. The job combines critical data analysis, strict confidentiality compliance, and formulating recommendations to ensure the quality of information for machine learning.

Posted September 9, 2026

Visual Creative Expert

• Writing, Creative & Design
• Platform: micro1
• Location: 58 countries

You will contribute to training AI models by evaluating and selecting images according to rigorous aesthetic criteria. Your visual expertise will enable you to judge the quality of composition, lighting, color and originality, while documenting your analyses to calibrate quality standards with other specialists.

Posted September 8, 2026

GitHub Contributor

• Software Engineering
• Platform: micro1
• Location: 58 countries

This role consists of creating reinforcement learning environments to test the capabilities of AI models in solving complex software engineering problems, including code correction, feature creation, and performance optimization. As an expert software engineer, you will produce quality code examples, debugging strategies, and reproducible reference solutions. The role requires confirmed expertise in programming and an established presence in open source.

Posted September 7, 2026

Software Engineer

• Software Engineering
• Platform: micro1
• Location: 58 countries

Create training environments and test cases to evaluate the capabilities of AI models in solving software engineering problems such as code correction, feature development, or performance optimization. This role is aimed at experienced software engineers with recognized expertise in at least one modern programming language.

Posted September 7, 2026

Attorney

• Legal
• Platform: micro1
• Location: 58 countries
• Level: Intermediate

This role invites legal specialists in contract law to contribute to a confidential project combining law and artificial intelligence. You will apply your transactional expertise to training next-generation AI systems by performing review and drafting tasks on commercial contracts, without needing prior knowledge of AI.

Posted September 6, 2026

Bilingual Croatian Generalist Expert - AI Safety

• Business, Consulting & Operations
• Platform: Mercor
• Location: United States
• Language: Croatian

This role involves evaluating and improving the safety of AI models by analyzing their behavior on sensitive topics in Croatian. You will write expert prompts, classify content according to structured guidelines, and identify adversarial formulations, as an English-Croatian bilingual speaker with no prior AI experience required.

Posted September 4, 2026

Bilingual Indonesian STEM Expert (PhD) - AI Safety

• Science & Research
• Platform: Mercor
• Location: United States
• Language: Indonesian

This remote-style role asks PhD scientists who are fluent in both English and Indonesian to help make AI models safer on technical subjects. Contributors write expert prompts in Indonesian, then judge model answers for accuracy, helpfulness, and handling of sensitive material. No prior AI experience is needed because the workflow is taught on the job.

Posted September 4, 2026

Bilingual Turkish Generalist Expert - AI Safety

• Data & Machine Learning
• Platform: Mercor
• Location: United States
• Language: Turkish

You will participate in improving AI model safety by evaluating how they handle sensitive subjects in Turkish. Your linguistic and cultural judgments will help identify and strengthen weaknesses in these systems when facing delicate content. No prior AI experience is required.

Posted September 4, 2026

Bilingual Ukrainian Generalist Expert - AI Safety

• Generalist & Data Labeling
• Platform: Mercor
• Location: United States
• Language: Ukrainian

This role involves contributing to AI model safety as a bilingual English-Ukrainian expert. You will evaluate how these models handle sensitive topics in Ukrainian, by writing expert prompts and classifying conversations according to structured guidelines. No prior experience in AI or machine learning is required.

Posted September 4, 2026

Bilingual Writer - Portuguese (Brazil)

• Languages, Translation & Voice
• Platform: Mercor
• Location: United States
• Language: Portuguese

You will be hired as a native speaker of Brazilian Portuguese to interact by voice with a next-generation AI assistant and evaluate its responses. You will compose messages, emails and notes via common applications, then rate the quality of the AI interactions in your language.

Posted September 4, 2026

Revenue Operations Specialist (SaaS)

• Business, Consulting & Operations
• Platform: micro1
• Location: 58 countries
• Level: Intermediate

This role involves improving operational efficiency and data quality within complex SaaS environments by documenting and optimizing revenue management processes. The ideal candidate brings deep hands-on experience with CRM systems and adjacent SaaS tools, particularly in regulated contexts, and will contribute to training next-generation AI systems through high-quality business insights.

Posted September 4, 2026

Certified Medical Coder (ICD-10) - Multilingual Clinical Documentation & AI Evaluation

• Health & Medicine
• Platform: Mercor
• Location: United States

This role involves evaluating and annotating clinical documents as well as notes generated by medical AI systems, applying your expertise in coding and clinical documentation. You will participate in a multilingual team responsible for ensuring the accuracy and reliability of AI tools in healthcare settings. The ideal candidate must possess recognized medical certification and be proficient in English as well as at least one other language at an advanced level.

Posted September 3, 2026