We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
About the role
We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you bring
A sharp eye for visual detail and the patience to look twice
Strong critical thinking, research skills, and reading comprehension
Sound judgment and well supported decision making
Professional written English, including the ability to describe what you see precisely
The consistency to apply detailed guidelines the same way, task after task
Experience in image annotation, content review, editing, research, design, or localization is welcome but not essential.
Posted 3 times
iMerit posted this role 3 times, usually once per city or country. We show it once. The pay shown covers all of them.
Official source: imerit.ai. Details can change; the platform's page is the final word. How we check listings.