This is a paid, three-day in-person user research study in Midtown Manhattan about how people use their phones, apps and everyday digital tools across languages and cultures. It is aimed at native Arabic speakers who use Arabic daily and can communicate in English, so that future products can better serve Arabic-speaking users.
Pay not disclosed
The platform does not publish the pay for this job.
Open to residents of: United States.
You apply on Mindrift, the AI training platform run by Toloka: submit your application for the role, pass a qualification step, then work on projects that match your expertise.
Official posting: https://apply.workable.com/j/9F658F57F9
Last checked on October 15, 2026.
This is a paid, in-person research study about how people use their phones, apps and everyday digital tools, and how those habits vary across languages and cultures. It is aimed at native German speakers who grew up in Austria, live locally, and use German daily, and it involves a short session of one to three days with a research team followed by a questionnaire.
Posted October 14, 2026
This paid research study examines how people use their phones, apps and everyday digital tools, and how those habits vary across languages and cultures. It is aimed at native Italian speakers living in New York who can attend an in-person session of one to three days in Midtown Manhattan. Participants talk through their daily routines, share examples of their phone activity and complete a short questionnaire about their habits.
Posted October 14, 2026
Join a red teaming team dedicated to AI safety: you will probe conversational models with adversarial inputs to discover vulnerabilities and generate robust test data. This role requires native mastery of English and Odia, as well as fine judgment to assess the relevance, accuracy, and appropriateness of AI responses when facing sensitive topics. You will document your findings in a reproducible manner so that clients can strengthen the security of their systems.
Posted June 4, 2026
This role involves evaluating and improving AI systems designed for Chinese language learning by assessing the linguistic accuracy, naturalness, and educational quality of AI-generated speech and text, as well as learner output across proficiency levels. The position is ideal for Chinese language experts with teaching or evaluation experience who want to directly influence how AI understands and teaches Chinese.
This role involves evaluating and improving AI systems trained on Italian-language content by assessing the linguistic accuracy and naturalness of AI-generated speech and text, as well as evaluating learner language across proficiency levels. The position is ideal for Italian language experts with teaching experience who want to shape how AI understands and teaches Italian.
This role involves evaluating and improving Arabic translations and AI-generated text by assessing fluency, tone, and cultural authenticity. Native or near-native Arabic speakers will teach language models to produce more natural, human-like Arabic output by rating translations, identifying gaps that automated systems miss, and rewriting model outputs to match native speaker standards.
