Audit AI annotations for accuracy and policy compliance. About Turing Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countries and the world's best foundational LLM companies, by helping them improve perform
About the role
Audit AI annotations for accuracy and policy compliance. About Turing
Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countries and the world's best foundational LLM companies, by helping them improve performance through model evaluation, fine-tuning, feedback, factuality and handling diverse data.
Role Overview
A US based AI company that is at the forefront of AI research is looking for a Team Lead to oversee a team of business analysts. This opportunity is tailored for professionals who have experience in leading teams and has interest in supporting the development of solutions at the cutting-edge of technology.
Job Responsibilities
Audit trainer-submitted evaluations for policy misapplication, incomplete reasoning, scoring drift, schema errors, and annotation inconsistencies.
Apply a detailed AI safety policy framework consistently across high-stakes review tasks.
Identify individual and systematic errors in human-generated annotations and written assessments.
Validate annotation completeness, scoring accuracy, policy alignment, and adherence to required schemas.
Provide direct, constructive feedback to trainers and recommend corrective actions when quality issues are identified.
Document recurring error patterns and contribute to quality improvement, calibration, and reviewer training initiatives.
Maintain accuracy and consistency while working under time-sensitive conditions and handling sensitive content.
Job Requirements
Sharp attention to detail and strong analytical and logical reasoning skills.
Demonstrated experience identifying systematic errors in human-generated annotations, evaluations, or written assessments.
Ability to quickly understand and consistently apply detailed policy guidelines.
Native-level English fluency and strong written communication skills.
Comfort providing clear, direct, and constructive feedback. …
Official source: work.turing.com. Details can change; the platform's page is the final word. How we check listings.
