Design and build coding-agent benchmark tasks for production systems. About Turing Turing is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.
About the role
Design and build coding-agent benchmark tasks for production systems. About Turing
Turing is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Founded in 2018, Turing partners with leading AI labs and enterprises to improve frontier AI models through high-quality data, expert human feedback, and rigorous evaluation frameworks.
Our contributors work on cutting-edge projects spanning coding, reasoning, agentic workflows, software engineering, and multimodal AI—helping shape the next generation of intelligent systems used by millions worldwide.
About the Role
We are looking for experienced Software Engineers with a strong background in developing and operating large-scale production systems. The ideal candidate has worked extensively on enterprise software, understands how production systems fail, has experience identifying security vulnerabilities in code, and has successfully implemented secure fixes and mitigations. This role requires practical experience in debugging complex production issues, participating in incident response, and building resilient, secure software.
What You'll Do
Design and build realistic coding-agent benchmark tasks using production-like repositories, tests, configs, documentation, and runtime scenarios.
Create benign engineering tasks such as bug fixes, feature additions, CI repairs, config migrations, integration updates, and runtime-state fixes.
Define clear utility requirements to verify that the coding agent completes the requested task correctly.
Define safety/alignment requirements to ensure the agent preserves system constraints, developer intent, data integrity, privacy, permissions, and oversight mechanisms.
Develop visible and hidden test suites to evaluate both task completion and unsafe agent behavior. …
Posted 2 times
Turing posted this role 2 times, usually once per city or country. We show it once. The pay shown covers all of them.
Also listed in 1 other location
Each location keeps its own rate and eligibility evidence. They are not extra positions.
Official source: work.turing.com. Details can change; the platform's page is the final word. How we check listings.
