OpenRecently verified

AI Developer Trace Task Auditor

  • Software Engineering
  • Platform: Mercor
  • Location: United States
  • Level: Intermediate

$70-90/hrAs published by the platform.

Not sure this job fits you?

  • Add your resume and see every open Software Engineering job scored against your background. Free.
  • Your profile is never sent to the platforms. You decide where to apply.
Add your resume

About this job

You will evaluate the quality and correctness of AI-assisted software development traces used to train and assess models at a leading AI laboratory. You must judge the accuracy of coding sessions, the consistency of workflows, and the quality of reasoning, then provide structured written feedback according to an evaluation grid.

What you'll do

  • Evaluate the correctness and quality of AI-assisted coding sessions produced with advanced development tools
  • Judge the robustness of workflow and the accuracy of technical reasoning in multi-step coding trajectories
  • Provide clear and structured written feedback based on an evaluation grid
  • Identify best practices and gaps in development traces generated by AI models

Requirements

Professional software developmentAI-assisted coding tools (Cursor, GitHub Copilot, Claude Code)Agent-based and specified workflowsCode reading and debuggingFull-stack or backend systemsMulti-step coding trace evaluation
  • 3+ years of experience

Pay

$70-90/hr

Pay as published by the platform. It is not a guarantee of income or hours.

Location

Open to residents of: United States.

How to apply

You apply on work.mercor.com: create a profile, complete a skills assessment, then get matched to projects that fit your background.

All Mercor jobs and how the platform works

Source

Official posting: https://work.mercor.com/jobs/list_AAABoEpz0r9yxMsCwGNKaJl4/ai-developer-trace-task-auditor

Last checked on November 20, 2026.

Similar jobs

  • Software Engineering
  • Platform: Alignerr
  • Level: Intermediate

This remote contract role asks senior TypeScript developers to review AI-generated code for type safety, scalability and modern practices. The work centers on writing structured feedback that helps AI models understand architectural choices and type logic. It is aimed at experienced developers who can work independently on flexible hourly commitments.

  • Software Engineering
  • Platform: Alignerr
  • Level: Intermediate

This contract role asks TypeScript developers to review and improve AI-generated code so it is type-safe, idiomatic, scalable and ready for production. It is aimed at senior developers with deep TypeScript knowledge who can clearly explain why a piece of code is well designed. No prior AI background is required.

  • Software Engineering
  • Platform: DataAnnotation

You will evaluate AI-generated code by running models on real engineering tasks, analyzing their output against production standards, and stress-testing them to find failures. This role is ideal for experienced software engineers who want to contribute to AI model improvement through rigorous code review and red-teaming.

Talent poolRecently verified$40-150/hr
  • Software Engineering
  • Platform: micro1
  • Location: 58 countries

This role involves contributing to an AI training project as an open source software engineer. You will explore unfamiliar repositories, implement and debug front-end and back-end components, and evaluate patches generated by AI. The ideal candidate is an experienced developer with significant contributions to established open source projects.

Posted September 16, 2026

OpenRecently verified$100-150/hr

Referral link to micro1's job list: search for this role there. Open this exact job

  • Software Engineering
  • Platform: Mercor
  • Location: United States
  • Level: Expert

This role invites experienced software engineers to evaluate and design migration strategies for complex codebases, particularly in mission-critical environments. You will analyze existing systems to identify safe modernization approaches and verify the quality of solutions generated by AI, while preserving functionality and security.

Posted August 22, 2026

OpenRecently verified$200/hr

Referral link: we may earn a fee. Apply without it

  • Software Engineering
  • Platform: DataAnnotation

Backend engineers will evaluate how AI models reason about system design, data modeling, and API contracts, identifying failures like race conditions and N+1 queries that only surface under real load. The role involves stress-testing model-generated backend code and writing correct solutions when models fall short, with explicit attention to scaling and consistency trade-offs.

Talent poolRecently verified$40-150/hr

Keep exploring

Apply on Mercor (opens Mercor in a new tab)

This is a referral link: we may earn a fee if you are selected and meet the platform's conditions.

Apply without the referral link