OpenRecently verified

Behavioral Health Expert, AI Safety and Model Evaluation

  • Health & Medicine
  • Platform: Mercor
  • Location: United States
  • Level: Intermediate

$45-70/hrAs published by the platform.

Not sure this job fits you?

  • Add your resume and see every open Health & Medicine job scored against your background. Free.
  • Your profile is never sent to the platforms. You decide where to apply.
Add your resume

About this job

This role involves evaluating and improving how AI models respond to sensitive conversations about relationships, emotional well-being, and personal beliefs. You will analyze whether the model's responses remain balanced, neutral, and safe, and you will help researchers define quality standards. This role is suited for professionals from mental health, counseling, or social work who can clearly articulate why one response is better than another.

What you'll do

  • Evaluate conversations between users and AI models on topics such as relationship advice, emotional well-being, and spiritual beliefs, verifying the neutrality and safety of responses.
  • Identify and document problematic patterns such as excessive agreement, bias, reinforcement of inaccurate beliefs, or drift toward clinical advice.
  • Develop evaluation frameworks, guidelines, and reference responses that define what constitutes a balanced and appropriate response.
  • Design test scenarios to evaluate how the model handles sensitive topics unrelated to crisis situations.

Requirements

PsychologyCounseling and therapySocial workNeutrality and non-judgmentAI safety conceptsTherapeutic boundariesWritten communication
  • 3+ years of experience
  • Bachelor's degree in psychology, counseling, social work, behavioral health, behavioral sciences, or related field

Pay

$45-70/hr

Pay as published by the platform. It is not a guarantee of income or hours.

Location

Open to residents of: United States.

How to apply

You apply on work.mercor.com: create a profile, complete a skills assessment, then get matched to projects that fit your background.

All Mercor jobs and how the platform works

Source

Official posting: https://work.mercor.com/jobs/list_AAABoP3B8SkA4VcfExhLrYa3/behavioral-health-expert-ai-safety-and-model-evaluation

Last checked on November 20, 2026.

Similar jobs

  • Health & Medicine
  • Platform: Mercor
  • Location: United States
  • Level: Entry level

This remote, part-time role asks a board-certified psychiatrist to assess how well AI models answer clinical psychiatry questions. The work involves reviewing de-identified patient charts and comparing AI responses for accuracy, safety and adherence to current standards of care. It is aimed at practicing psychiatrists with an active, unrestricted medical license who can give careful written feedback.

Posted October 24, 2026

OpenRecently verified$150/hr

Referral link: we may earn a fee. Apply without it

  • Health & Medicine
  • Platform: Vetto

This freelance role asks mental health professionals to take part in multi-turn simulated conversations with an AI system, playing a patient persona in scenarios involving emotional distress, suicidal ideation, and depression. Contributors then review the AI's replies against clinical criteria such as risk recognition, empathy, and crisis-response practice. It is aimed at licensed or formally trained clinicians and other mental health practitioners.

Posted May 8, 2026

OpenRecently verifiedPay not disclosed
  • Health & Medicine
  • Platform: Vetto

This project asks wellness professionals to examine realistic wellness scenarios that will be used to train AI wellness assistants. The work is to spot risks, contraindications, context, and trade-offs, then rewrite weak cases so they test sound professional judgment. It is aimed at practitioners such as psychologists, therapists, dietitians, personal trainers, and strength and conditioning coaches.

Posted February 20, 2026

OpenRecently verifiedPay not disclosed
  • Software Engineering
  • Platform: Alignerr

This role involves analyzing security vulnerabilities and threat scenarios in AI systems and large language models to identify weaknesses and recommend mitigations. Security professionals will conduct adversarial testing, evaluate real-world attack scenarios, and provide structured feedback to improve AI safety and resilience.

  • Software Engineering
  • Platform: Alignerr

Penetration testing experts are needed to identify security vulnerabilities in AI-powered applications and infrastructure through offensive security testing. This remote contract role combines traditional penetration testing methodologies with emerging AI-specific attack scenarios such as prompt injection and model manipulation.

  • Data & Machine Learning
  • Platform: micro1
  • Location: 58 countries

This contract brings security specialists in to probe AI models for weaknesses such as jailbreaks and prompt injection. The work centers on designing adversarial test strategies, maintaining regression suites, and reporting findings to technical and non-technical audiences. It suits people with a background in cybersecurity or adversarial machine learning who want to help make models safer.

Posted October 28, 2026

OpenRecently verified$50-90/hr

Referral link to micro1's job list: search for this role there. Open this exact job

Keep exploring

Apply on Mercor (opens Mercor in a new tab)

This is a referral link: we may earn a fee if you are selected and meet the platform's conditions.

Apply without the referral link