OpenRecently verified

Search Quality Evaluator

  • Data & Machine Learning
  • Platform: Alignerr

$40-120/hrAs published by the platform.

About this job

This remote, hourly contract involves judging how relevant, accurate, and useful search results, AI-generated answers, and content recommendations are, using structured rubrics. It suits people with good general knowledge, sound judgment, and strong English writing who can work independently, with no technical or AI background needed.

What you'll do

  • Evaluate search results for relevance, accuracy, and usefulness.
  • Rate AI-generated answers and content recommendations using structured rubrics.
  • Compare multiple results side by side and rank them by quality.
  • Write clear, concise explanations supporting each rating.

Requirements

Search engine evaluationWeb researchStructured evaluation rubrics

    Pay

    $40-120/hr

    Pay as published by the platform. It is not a guarantee of income or hours.

    Location

    The platform has not published which countries are eligible for this job.

    How to apply

    You apply on Alignerr, Labelbox's expert network: create a profile, complete an AI-led interview and skills assessment, then get matched to projects in your field.

    All Alignerr jobs and how the platform works

    Source

    Official posting: https://www.alignerr.com/jobs/12c61379-2937-4933-a0a2-77aea638fda5

    Last checked on October 8, 2026.

    Similar jobs

    • Generalist & Data Labeling
    • Platform: Mercor
    • Location: United States

    This role involves participating in the evaluation and improvement of AI models by providing expert human judgment. You will be asked to write reference questions, rate generated responses, and identify errors or inconsistencies in models. The position suits candidates from varied educational backgrounds who master close reading and written communication.

    Posted September 15, 2026

    OpenRecently verified$40-70/hr

    Referral link: we may earn a fee. Apply without it

    • Data & Machine Learning
    • Platform: Mercor
    • Location: United States
    • Level: Intermediate

    Mercor is recruiting research experts capable of improving and evaluating cutting-edge AI models. You will contribute to creating high-quality training materials (questions, answers, evaluations) for advanced language models. This role is aimed at candidates holding a Master's degree or with 2 to 3 years of experience, with strong research and communication skills.

    Posted July 26, 2026

    OpenRecently verified$50-60/hr

    Referral link: we may earn a fee. Apply without it

    • Generalist & Data Labeling
    • Platform: Alignerr

    This remote contract role involves checking the accuracy of statements produced by AI systems by researching them against reliable sources. The work spans many subjects, from science and history to current events, and suits people with strong research habits and a careful, skeptical approach. No specific academic background or prior AI experience is required.

    • Legal
    • Platform: micro1
    • Location: 58 countries

    This role invites legal professionals to evaluate and analyze legal content generated by advanced AI systems, judging the clarity, precision, and quality of writing. You will apply your subject matter expertise to identify imprecise texts, poorly supported arguments, or statements lacking foundation, without providing legal advice or representing clients.

    Posted September 18, 2026

    OpenRecently verified$90-140/hr

    Referral link to micro1's job list: search for this role there. Open this exact job

    • Business, Consulting & Operations
    • Platform: micro1
    • Location: 58 countries

    This role consists of evaluating and scoring responses generated by AI systems on various types of professional content (specifications, release notes, communications). You will analyze writing quality, compliance with instructions, and suitability for the target audience, providing detailed justifications. This role is aimed at experienced product managers or product owners who know how to evaluate technical and business content.

    Posted September 11, 2026

    OpenRecently verified$90-140/hr

    Referral link to micro1's job list: search for this role there. Open this exact job

    • Data & Machine Learning
    • Platform: Alignerr

    This role involves testing and evaluating AI chatbot responses across diverse topics by engaging in conversations, identifying issues, and providing structured feedback. The position is designed for individuals with strong critical thinking and communication skills who want to contribute to AI safety and improvement without requiring prior technical or AI experience.

    Keep exploring