$40-150/hrAs published by the platform.
Evaluate how AI models handle DevOps tasks such as CI/CD pipelines, infrastructure-as-code, and cloud operations. Identify failures in automation, security configurations, and deployment processes, then write correct solutions that a platform engineer would trust.
$40-150/hr
Pay as published by the platform. It is not a guarantee of income or hours.
The platform has not published which countries are eligible for this job.
You apply on DataAnnotation: create an account, take the qualification assessment for your field, then pick up paid projects when you qualify.
Official posting: https://www.dataannotation.tech/job-board/devops-engineer
Last checked on October 8, 2026.
Design and evaluate infrastructure and automation challenges to train and benchmark AI systems used by leading research labs and Fortune 500 companies. This remote contract role is for experienced DevOps engineers to create realistic cloud infrastructure scenarios, write Infrastructure as Code, and assess how well AI models understand and reason about complex DevOps concepts.
This remote contract role involves designing and building the software that measures how well AI models perform, including evaluation pipelines, automated testing harnesses, and internal dashboards and APIs. It suits senior engineers who have shipped production systems and want to work closely with AI research teams on reliable, repeatable evaluation tooling.
This job involves evaluating the quality and compliance of Kubernetes scenarios for AI model training. You will analyze manifests, diagnose cluster failures, and provide structured feedback according to an evaluation grid, as a DevOps expert or platform engineer.
Posted August 28, 2026
This role invites experienced software engineers to evaluate and design migration strategies for complex codebases, particularly in mission-critical environments. You will analyze existing systems to identify safe modernization approaches and verify the quality of solutions generated by AI, while preserving functionality and security.
Posted August 22, 2026
This role involves contributing to the training of AI systems by simulating authentic software development activities. You will execute structured evaluations covering version control, code review, continuous integration, and workflow automation, verifying the technical quality of results in realistic environments. No prior AI experience is required, only your software development expertise matters.
Posted August 18, 2026
Referral link to micro1's job list: search for this role there. Open this exact job
This role supports AI model training by writing, correcting, and curating code examples in specialized programming languages. It suits experienced software engineers who can judge whether code meets professional standards for performance, scalability, and reliability.
Posted February 26, 2026
