$50-70/hrAs published by the platform.
This remote contract role asks experienced software engineers to assess and rank code produced by AI models. The work involves judging correctness, efficiency and maintainability, then writing structured feedback that helps coding assistants learn what good code looks like. It suits developers who prefer flexible, independent, task-based work.
$50-70/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on Alignerr, Labelbox's expert network: create a profile, complete an AI-led interview and skills assessment, then get matched to projects in your field.
Official posting: https://www.alignerr.com/jobs/0af700c4-6319-43f0-8bba-08d28f336f48
Last checked on October 8, 2026.
This role involves evaluating and providing feedback on AI-generated Python code for correctness, efficiency, and security while designing complex backend algorithmic solutions. It is designed for experienced backend Python developers who want to contribute to cutting-edge AI research by helping train the next generation of AI systems to write better code.
This role involves reviewing and evaluating AI-generated Rust code to ensure correctness, memory safety, and systems-level performance. Experienced Rust engineers will assess the quality of AI outputs, design challenging problems to test AI understanding, and provide structured feedback to improve how AI models reason about systems programming.
This is a paid evaluation role for database engineers who will design realistic tasks that test how well AI agents handle database work. Each task is a self-contained problem with a reproducible environment, a working reference solution, tests, and grading criteria that separate robust engineering from code that only looks correct. It is aimed at experts with deep database-engine internals experience, not at DBA, SQL analytics, or ETL-only profiles.
Posted October 6, 2026
Evaluation of AI model outputs against correctness, maintainability, security, and production readiness criteria, accessible to early-to-mid career professionals.
This remote study asks practicing software engineers to review programming tasks and the evaluation harnesses built to test AI agents on them. You will check whether the tasks, test cases and environment structure reflect realistic software engineering work. It suits engineers with solid experience building, testing and reviewing complex systems.
Posted October 2, 2026
This role consists of creating reinforcement learning environments to test the capabilities of AI models in solving complex software engineering problems, including code correction, feature creation, and performance optimization. As an expert software engineer, you will produce quality code examples, debugging strategies, and reproducible reference solutions. The role requires confirmed expertise in programming and an established presence in open source.
Posted September 7, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
