This is a paid, multi-day in-person research study on how people use their phones, apps and everyday digital tools across languages and cultures. It is aimed at adults who speak German natively and use it daily, and who are willing to share their everyday phone habits with a research team.
Pay not disclosed
The platform does not publish the pay for this job.
Open to residents of: United States.
You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.
Official posting: https://apply.workable.com/j/C30810226E
Last checked on October 16, 2026.
This role involves evaluating and improving AI systems designed for Chinese language learning by assessing the linguistic accuracy, naturalness, and educational quality of AI-generated speech and text, as well as learner output across proficiency levels. The position is ideal for Chinese language experts with teaching or evaluation experience who want to directly influence how AI understands and teaches Chinese.
This role involves evaluating and improving AI systems trained on Italian-language content by assessing the linguistic accuracy and naturalness of AI-generated speech and text, as well as evaluating learner language across proficiency levels. The position is ideal for Italian language experts with teaching experience who want to shape how AI understands and teaches Italian.
This role involves evaluating and improving Arabic translations and AI-generated text by assessing fluency, tone, and cultural authenticity. Native or near-native Arabic speakers will teach language models to produce more natural, human-like Arabic output by rating translations, identifying gaps that automated systems miss, and rewriting model outputs to match native speaker standards.
A Bengali specialist evaluates and corrects AI-generated Bengali text, focusing on accurate pronoun usage, regional variations, and natural phrasing. The role involves reviewing translations, scoring model outputs, and providing native-speaker feedback to improve AI language understanding.
This is an in-person research study on how people use their phones, apps and everyday digital tools, and how those habits vary across languages and cultures. It is open to native Italian speakers living in New York who can take part over three consecutive days in Midtown Manhattan. The findings aim to help future products work better for people who communicate in Italian.
Posted October 15, 2026
This is a paid, in-person user research study on how people use their phones, apps and everyday digital tools in Italian, with sessions lasting one to three days in Midtown Manhattan. It is aimed at native Italian speakers who live in New York and can take part on three consecutive days.
Posted October 15, 2026
