OpenRecently verified

Machine Learning Evaluation Specialist

  • Data & Machine Learning
  • Platform: Alignerr

$200-400/hrAs published by the platform.

About this job

This remote contract role asks domain experts with graduate-level training to write hard machine learning evaluation problems that test how advanced AI systems reason. Specialists also judge AI-generated solutions for correctness, creativity and methodological rigor, and they document difficulty and likely failure modes. It suits researchers whose deep, niche expertise goes beyond standard ML knowledge.

What you'll do

  • Design original machine learning problems rooted in your specialized domain
  • Write problem statements with defined evaluation criteria and gold-standard solutions
  • Assess AI-generated ML solutions for correctness, creativity and methodological rigor
  • Document problem difficulty, required domain knowledge and expected failure modes

Requirements

Machine LearningNLP
  • Graduate-level education in a scientific or technical domain

Pay

$200-400/hr

Pay as published by the platform. It is not a guarantee of income or hours.

Location

The platform has not published which countries are eligible for this job.

How to apply

You apply on Alignerr, Labelbox's expert network: create a profile, complete an AI-led interview and skills assessment, then get matched to projects in your field.

All Alignerr jobs and how the platform works

Source

Official posting: https://www.alignerr.com/jobs/0e671fa7-f786-42be-9d53-6f97cff0a18f

Last checked on October 8, 2026.

Similar jobs

  • Data & Machine Learning
  • Platform: Alignerr

A fully remote contract role where PhD-level biochemists create expert-level problems, author gold-standard solutions, and audit AI-generated biochemical reasoning to train and improve scientific AI models. Ideal for biochemists passionate about scientific rigor who want to shape the accuracy of next-generation AI without requiring prior AI experience.

  • Data & Machine Learning
  • Platform: Alignerr

This role involves designing and evaluating advanced biology problems to help train AI models to reason rigorously about scientific topics like genetics, biotechnology, and bioinformatics. Masters and PhD holders in biology will apply their domain expertise to assess AI-generated reasoning for scientific accuracy and clarity in a fully remote, flexible contract position.

  • Data & Machine Learning
  • Platform: DataAnnotation
  • Level: Intermediate

This role involves evaluating how well AI models can perform computational biology tasks. Computational biologists and bioinformaticians will design realistic analysis scenarios from their own work, run them through AI systems, and grade the results against professional standards to help benchmark model capabilities.

Talent poolRecently verified$40-125/hr
  • Data & Machine Learning
  • Platform: DataAnnotation

As a Machine Learning Engineer, you will evaluate and improve how AI models reason about machine learning systems, including training dynamics, evaluation design, and deployment strategies. You will write prompts to test model reasoning, identify subtle errors in AI outputs, and provide correct solutions based on real practitioner experience.

Talent poolRecently verified$40-150/hr

Keep exploring