OpenRecently verified

Domain Contributor - Evaluation Specialist

  • Data & Machine Learning
  • Platform: micro1
  • Location: 58 countries

$30-60/hrAs published by the platform.

About this job

This is a remote, contract role in which domain experts design demanding tasks and questions that test the limits of advanced AI models. Contributors check model outputs against authoritative primary sources and write clear rationales for errors, missed reasoning, and nuances. It suits specialists in history, law, finance, journalism, or technology who already have prior experience training or evaluating AI models.

What you'll do

  • Design domain-specific tasks that expose reasoning flaws in AI models.
  • Verify AI-generated answers against primary sources in your field.
  • Write clear rationales explaining where and why a model falls short.
  • Apply the provided evaluation rubrics consistently to every submission.

Requirements

Domain depthSource verificationReasoning clarityEvaluation expertise

    Pay

    $30-60/hr

    Pay as published by the platform. It is not a guarantee of income or hours.

    Location

    Open to residents of: Bangladesh, Hong Kong SAR China, India, Indonesia, Japan, Kazakhstan, Kyrgyzstan, Malaysia, Pakistan, Philippines, Singapore, Sri Lanka, Taiwan, Thailand, Uzbekistan, Vietnam, Austria, Belarus, Belgium, Denmark, France, Germany, Greece, Italy, Netherlands, Portugal, Russia, Spain, Switzerland, United Kingdom, Argentina, Brazil, Chile, Colombia, Mexico, Peru, Algeria, Bahrain, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Morocco, Oman, Palestinian Territories, Qatar, Saudi Arabia, Tunisia, United Arab Emirates, United States, Canada, Nigeria, Kenya, South Africa, Ghana, Ethiopia.

    How to apply

    You apply on micro1: create an account, complete a screening interview with its AI interviewer, then join its vetted expert network to be matched to projects.

    All micro1 jobs and how the platform works

    Source

    Official posting: https://jobs.micro1.ai/post/c476c74d-96cc-4254-ab50-282849e9de5b

    Last checked on October 22, 2026.

    Similar jobs

    • Data & Machine Learning
    • Platform: Alignerr

    This role involves testing and evaluating AI chatbot responses across diverse topics by engaging in conversations, identifying issues, and providing structured feedback. The position is designed for individuals with strong critical thinking and communication skills who want to contribute to AI safety and improvement without requiring prior technical or AI experience.

    • Data & Machine Learning
    • Platform: Alignerr

    This role involves testing and evaluating AI models by designing adversarial prompts and scenarios to identify weaknesses, biases, and unsafe outputs. Red team testers document discovered failure modes and assess their severity to help improve AI safety before deployment.

    • Data & Machine Learning
    • Platform: Terac
    • Location: United States

    This is a paid one-hour trial for people who know a professional or personal workflow well. Participants turn that workflow into a demanding prompt, test it in ChatGPT to find where the model fails, and make the prompt harder when the model succeeds. The work suits domain experts and power users who can judge AI outputs quickly and who are open to ongoing evaluation work.

    Posted August 25, 2026

    OpenRecently verifiedPay not disclosed
    • Data & Machine Learning
    • Platform: Mercor
    • Location: United States
    • Level: Intermediate

    We are looking for experienced machine learning researchers to work on empirical research problems covering computer vision, language models, and robustness to adversarial attacks. You will train and improve end-to-end models, optimizing trade-offs between performance, efficiency, and robustness in resource-constrained contexts.

    Posted August 5, 2026

    OpenRecently verified$100-120/hr

    Referral link: we may earn a fee. Apply without it

    • Software Engineering
    • Platform: DataAnnotation

    This role involves evaluating how AI models reason about offensive security concepts and identifying flaws in their exploit chain reasoning. Penetration testers with hands-on red team experience will test model outputs across reconnaissance, exploitation, privilege escalation, and lateral movement, then write accurate attack paths that reflect real-world tradecraft when models fall short.

    Talent poolRecently verified$40-125/hr
    • Software Engineering
    • Platform: DataAnnotation

    You will evaluate AI-generated code by running models on real engineering tasks, analyzing their output against production standards, and stress-testing them to find failures. This role is ideal for experienced software engineers who want to contribute to AI model improvement through rigorous code review and red-teaming.

    Talent poolRecently verified$40-150/hr

    Keep exploring

    Apply on micro1 (opens micro1 in a new tab)

    This referral link opens micro1's list of open roles, not this exact job. Once there, search for Domain Contributor - Evaluation Specialist. We may earn a fee if you are selected and meet the platform's conditions.

    Open this exact job, without the referral link