OpenRecently verified

AI Agent Evaluator

  • Data & Machine Learning
  • Platform: micro1
  • Location: 58 countries
  • Level: Intermediate

$25-45/hrAs published by the platform.

Not sure this job fits you?

  • Add your resume and see every open Data & Machine Learning job scored against your background. Free.
  • Your profile is never sent to the platforms. You decide where to apply.
Add your resume

About this job

This contract role has a user run everyday errands such as bills, bookings, shopping and forms through two AI agents, using their own accounts and phone. The evaluator approves or stops the agent at key steps, records each attempt, and scores completion, quality, control issues and satisfaction. It suits people who already use AI daily and can document each step carefully.

What you'll do

  • Run everyday errands with two AI agents side by side on your own accounts.
  • Approve or stop the agent at key steps during each run.
  • Screen record every attempt and score each run.
  • Share clear written feedback on the agent experience.

Requirements

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen RecordingDotsMobile
  • 2+ years of experience
  • Bachelor's degree

Pay

$25-45/hr

Pay as published by the platform. It is not a guarantee of income or hours.

Location

Open to residents of: Bangladesh, Hong Kong SAR China, India, Indonesia, Japan, Kazakhstan, Kyrgyzstan, Malaysia, Pakistan, Philippines, Singapore, Sri Lanka, Taiwan, Thailand, Uzbekistan, Vietnam, Austria, Belarus, Belgium, Denmark, France, Germany, Greece, Italy, Netherlands, Portugal, Russia, Spain, Switzerland, United Kingdom, Argentina, Brazil, Chile, Colombia, Mexico, Peru, Algeria, Bahrain, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Morocco, Oman, Palestinian Territories, Qatar, Saudi Arabia, Tunisia, United Arab Emirates, United States, Canada, Nigeria, Kenya, South Africa, Ghana, Ethiopia.

How to apply

You apply on micro1: create an account, complete a screening interview with its AI interviewer, then join its vetted expert network to be matched to projects.

All micro1 jobs and how the platform works

Source

Official posting: https://jobs.micro1.ai/post/b884c432-4a78-4169-bd33-2e6c6320f987

Last checked on November 5, 2026.

Similar jobs

  • Business, Consulting & Operations
  • Platform: DataAnnotation

This role asks experienced consultants to test cutting-edge AI models on business problems drawn from their own practice. Contributors write client-style briefs, review each response as they would an associate's work, and flag where recommendations are sharp and where they are generic. It suits people with consulting, strategy, PMO, or deal advisory backgrounds.

Talent poolRecently verified$40-125/hr
  • Business, Consulting & Operations
  • Platform: micro1
  • Location: 58 countries

This contract role asks former special operations and irregular warfare professionals to help build and check unclassified military scenarios used in AI training and evaluation. The work is project-based and involves judging whether tactical and operational reasoning in military content is realistic, accurate, and well supported. It suits people with hands-on military planning or special operations experience who can give structured feedback.

Posted November 4, 2026

OpenRecently verified$50-100/hr

Referral link to micro1's job list: search for this role there. Open this exact job

  • Business, Consulting & Operations
  • Platform: micro1
  • Location: 58 countries

This is a remote, project-based contractor role for experienced military training and readiness specialists. The work involves building unclassified training scenarios, reviewing training content against doctrine, and assessing operational preparedness so that AI systems describe military training and readiness accurately. It suits people with prior experience in military training, readiness assessment, doctrine, or defense education.

Posted November 4, 2026

OpenRecently verified$50-100/hr

Referral link to micro1's job list: search for this role there. Open this exact job

  • Data & Machine Learning
  • Platform: Mercor
  • Location: United States
  • Level: Intermediate

Mercor is recruiting research experts capable of improving and evaluating cutting-edge AI models. You will contribute to creating high-quality training materials (questions, answers, evaluations) for advanced language models. This role is aimed at candidates holding a Master's degree or with 2 to 3 years of experience, with strong research and communication skills.

Posted July 26, 2026

OpenRecently verified$50-60/hr

Referral link: we may earn a fee. Apply without it

  • Business, Consulting & Operations
  • Platform: Alignerr
  • Level: Intermediate

The role involves reviewing AI-generated management and leadership scenarios and judging the reasoning behind them, so that AI systems handle organizational behavior and decision-making more accurately. It is aimed at experienced management educators who can spot flawed logic and give structured, constructive feedback. The work is remote, asynchronous, and done on a flexible schedule.

  • Science & Research
  • Platform: Alignerr
  • Level: Intermediate

This freelance remote role asks conservation and environmental science professionals to check how AI systems handle questions about ecosystems, land use, soil, water and biodiversity. The reviewer judges whether the scientific content and recommendations match sound practice, then gives structured, actionable feedback to improve the model's reasoning. It suits experienced practitioners who want to shape AI reliability while working on their own schedule.

Keep exploring

Apply on micro1 (opens micro1 in a new tab)

This referral link opens micro1's list of open roles, not this exact job. Once there, search for AI Agent Evaluator. We may earn a fee if you are selected and meet the platform's conditions.

Open this exact job, without the referral link