$70-120/hrAs published by the platform.
This remote, task-based contract involves designing realistic engineering challenges that evaluate advanced AI agents on enterprise work such as diagnosing failing integrations, tracing bugs, and writing fixes. It is aimed at working software engineers who debug real systems, write infrastructure and configuration code, and can verify their fixes in live or simulated environments.
$70-120/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on Alignerr, Labelbox's expert network: create a profile, complete an AI-led interview and skills assessment, then get matched to projects in your field.
Official posting: https://www.alignerr.com/jobs/00809f62-9f65-480e-b865-9e69350ec606
Last checked on October 8, 2026.
This remote contract role involves designing and building the software that measures how well AI models perform, including evaluation pipelines, automated testing harnesses, and internal dashboards and APIs. It suits senior engineers who have shipped production systems and want to work closely with AI research teams on reliable, repeatable evaluation tooling.
Evaluation and comparison of AI model solutions on realistic software engineering tasks: debugging, cross-repository logic tracing, feature implementation, code review, architecture decisions.
This role involves evaluating and providing feedback on AI-generated Python code for correctness, efficiency, and security while designing complex backend algorithmic solutions. It is designed for experienced backend Python developers who want to contribute to cutting-edge AI research by helping train the next generation of AI systems to write better code.
Evaluate how AI models handle DevOps tasks such as CI/CD pipelines, infrastructure-as-code, and cloud operations. Identify failures in automation, security configurations, and deployment processes, then write correct solutions that a platform engineer would trust.
You will evaluate AI-generated code by running models on real engineering tasks, analyzing their output against production standards, and stress-testing them to find failures. This role is ideal for experienced software engineers who want to contribute to AI model improvement through rigorous code review and red-teaming.
You will contribute to training next-generation AI models by creating realistic coding tasks and implementing deterministic verifiers. This flexible contracting role is aimed at experienced backend engineers capable of generating relevant technical challenges and automatically evaluating solutions.
Posted October 6, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
