Fully remote, project-based work checking how well AI coding agents handle real software engineering. You write tasks based on your own experience and grade where the agent gets it wrong.
About the role
Fully remote, project-based work checking how well AI coding agents handle real software engineering. You write tasks based on your own experience and grade where the agent gets it wrong. $40 to $125 USD an hour, at least 10 hours a week, as an independent contractor. For working software engineers in the US, UK, Ireland, Canada, or Australia. AI coding agents produce working code quickly, and it is not always code a good engineer would ship. This role puts your experience to work finding out where. You turn engineering problems you know into realistic tasks, run them through AI agents, and judge the answers the way you would review a colleague's pull request. You set your own schedule, and the work rewards careful writing as much as expertise.
Official source: app.sovrano.ai. Details can change; the platform's page is the final word. How we check listings.
