$80-120/hrAs published by the platform.
This is a remote, hourly contract role for senior software engineers who will help build, test and improve autonomous AI coding agents. The work centers on judging whether AI-written code is correct, efficient, secure and well designed, and on finding where these agents fail. It suits experienced engineers who can read unfamiliar codebases and explain clearly why code works or breaks.
$80-120/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on Alignerr, Labelbox's expert network: create a profile, complete an AI-led interview and skills assessment, then get matched to projects in your field.
Official posting: https://www.alignerr.com/jobs/31cc7387-94ce-48d9-bbec-9433c2e69eb8
Last checked on October 8, 2026.
This remote contract role involves designing and building the software that measures how well AI models perform, including evaluation pipelines, automated testing harnesses, and internal dashboards and APIs. It suits senior engineers who have shipped production systems and want to work closely with AI research teams on reliable, repeatable evaluation tooling.
Evaluation and comparison of AI model solutions on realistic software engineering tasks: debugging, cross-repository logic tracing, feature implementation, code review, architecture decisions.
This role invites experienced software engineers to evaluate and design migration strategies for complex codebases, particularly in mission-critical environments. You will analyze existing systems to identify safe modernization approaches and verify the quality of solutions generated by AI, while preserving functionality and security.
Posted August 22, 2026
This role involves evaluating and providing feedback on AI-generated Python code for correctness, efficiency, and security while designing complex backend algorithmic solutions. It is designed for experienced backend Python developers who want to contribute to cutting-edge AI research by helping train the next generation of AI systems to write better code.
Evaluate how AI models handle DevOps tasks such as CI/CD pipelines, infrastructure-as-code, and cloud operations. Identify failures in automation, security configurations, and deployment processes, then write correct solutions that a platform engineer would trust.
This remote study asks practicing software engineers to review programming tasks and the evaluation harnesses built to test AI agents on them. You will check whether the tasks, test cases and environment structure reflect realistic software engineering work. It suits engineers with solid experience building, testing and reviewing complex systems.
Posted October 2, 2026
