$40-150/hrAs published by the platform.
Backend engineers will evaluate how AI models reason about system design, data modeling, and API contracts, identifying failures like race conditions and N+1 queries that only surface under real load. The role involves stress-testing model-generated backend code and writing correct solutions when models fall short, with explicit attention to scaling and consistency trade-offs.
$40-150/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on DataAnnotation: create an account, take the qualification assessment for your field, then pick up paid projects when you qualify.
Official posting: https://www.dataannotation.tech/job-board/backend-engineer
Last checked on October 8, 2026.
This role involves designing and optimizing Python-based backend systems for data annotation, validation, and AI model training infrastructure. The position requires a senior full-stack engineer to build high-performance data pipelines, asynchronous task queues, and evaluation systems used by leading AI labs.
This role involves evaluating and providing feedback on AI-generated Python code for correctness, efficiency, and security while designing complex backend algorithmic solutions. It is designed for experienced backend Python developers who want to contribute to cutting-edge AI research by helping train the next generation of AI systems to write better code.
Evaluation and comparison of AI model solutions on realistic software engineering tasks: debugging, cross-repository logic tracing, feature implementation, code review, architecture decisions.
This remote study asks practicing software engineers to review programming tasks and the evaluation harnesses built to test AI agents on them. You will check whether the tasks, test cases and environment structure reflect realistic software engineering work. It suits engineers with solid experience building, testing and reviewing complex systems.
Posted October 2, 2026
You will evaluate the quality and correctness of AI-assisted software development traces used to train and assess models at a leading AI laboratory. You must judge the accuracy of coding sessions, the consistency of workflows, and the quality of reasoning, then provide structured written feedback according to an evaluation grid.
Posted August 28, 2026
This role supports AI model training by writing, correcting, and curating code examples in specialized programming languages. It suits experienced software engineers who can judge whether code meets professional standards for performance, scalability, and reliability.
Posted February 26, 2026
