OpenRecently verified

ML Challenge Task Auditor

  • Data & Machine Learning
  • Platform: Mercor
  • Location: United States
  • Level: Intermediate

$70-90/hrAs published by the platform.

Not sure this job fits you?

  • Add your resume and see every open Data & Machine Learning job scored against your background. Free.
  • Your profile is never sent to the platforms. You decide where to apply.
Add your resume

About this job

You will evaluate the methodological quality and scientific rigor of machine learning tasks designed to train and test models at a cutting-edge AI laboratory. You will provide structured feedback on experimental design, model selection and evaluation protocols, critiquing claims against observed results.

What you'll do

  • Evaluate the quality and rigor of machine learning experimental protocols
  • Analyze experiment design, model selection and evaluation methodology
  • Detect data leakage, metric bias and cross-validation issues
  • Provide detailed feedback based on explicit criteria

Requirements

PyTorchTensorFlowLLM
  • 3+ years of experience

Pay

$70-90/hr

Pay as published by the platform. It is not a guarantee of income or hours.

Location

Open to residents of: United States.

How to apply

You apply on work.mercor.com: create a profile, complete a skills assessment, then get matched to projects that fit your background.

All Mercor jobs and how the platform works

Source

Official posting: https://work.mercor.com/jobs/list_AAABoEpzlEigUmznqXNFkJZb/ml-challenge-task-auditor

Last checked on November 20, 2026.

Similar jobs

  • Data & Machine Learning
  • Platform: Mercor
  • Location: United States

Join a network of machine learning experts to access occasional jobs with AI laboratories and companies. You will contribute to training and evaluating models, creating tasks based on real-world scenarios, and providing domain feedback for AI research. This program is aimed at engineers with solid experience in machine learning model development and capable of working independently on remote projects.

Posted February 27, 2026

Talent poolRecently verified$70-250/hr

Referral link: we may earn a fee. Apply without it

  • Data & Machine Learning
  • Platform: Alignerr

This role involves designing advanced data science challenges, writing benchmark solutions, and auditing AI-generated code to improve AI reasoning and reliability. It is designed for experienced data scientists who want flexible, intellectually demanding work training and evaluating machine learning systems.

  • Data & Machine Learning
  • Platform: DataAnnotation

As a Machine Learning Engineer, you will evaluate and improve how AI models reason about machine learning systems, including training dynamics, evaluation design, and deployment strategies. You will write prompts to test model reasoning, identify subtle errors in AI outputs, and provide correct solutions based on real practitioner experience.

Talent poolRecently verified$40-150/hr
  • Data & Machine Learning
  • Platform: micro1
  • Location: 58 countries

This role enables a machine learning engineer to contribute to the development of next-generation AI systems by designing and refining machine learning models. You will apply your expertise in Python and ML frameworks to process large volumes of data, optimize model performance, and deliver actionable insights based on rigorous analysis.

Posted April 17, 2026

OpenRecently verified$80-140/hr

Referral link to micro1's job list: search for this role there. Open this exact job

  • Data & Machine Learning
  • Platform: Vetto

This role is a hands-on research position focused on post-training large language models, where expert annotations are converted into training data and experimental reward signals. It suits a researcher with a PhD or equivalent experience in machine learning or a related quantitative field who can work independently and iterate fast on messy experiments.

Posted January 23, 2026

OpenRecently verifiedPay not disclosed

Keep exploring

Apply on Mercor (opens Mercor in a new tab)

This is a referral link: we may earn a fee if you are selected and meet the platform's conditions.

Apply without the referral link