In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reason through legal problems, and build cases that test the limits of that… In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reas
About the role
In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reason through legal problems, and build cases that test the limits of that…
In this remote, hourly contractor role, you will apply professional legal judgement to evaluate how advanced AI models reason through legal problems, and build cases that test the limits of that reasoning. Project scopes vary and may include:
-
Designing legal questions, prompts, and evaluation sets grounded in real practice, including matters involving ambiguity, competing authorities, and high-stakes decisions
-
Evaluating AI-generated legal analysis for accuracy, reasoning quality, and citation support, identifying misread authority, unsupported assumptions, misapplied rules, and unflagged legal risk
-
Reviewing and annotating legal documents against detailed instructions, producing citation-backed determinations with clear plain-language explanations
-
Contract review and redlining, including clause-level analysis and simulated negotiation exercises
-
Assessing AI performance on compliance and regulatory scenarios, including regulatory obligations, disclosure requirements, and enforcement contexts
-
Rating and comparing AI responses against structured rubrics, applied consistently across task types
-
Flagging ambiguity and jurisdictional variation, and quality-checking the work of other reviewers
### Profile Requirements
-
Law degree (LLB, LLM, JD, or equivalent)
-
Professional experience in legal practice, in-house counsel, compliance, regulatory affairs, or legal academia
-
Strong command of legal reasoning: statutory interpretation, application of precedent, risk identification, and defensible argument construction
-
Ability to explain complex legal concepts and corrections clearly and accurately in writing
-
Full professional English proficiency
-
Exceptional attention to detail
- …
Official source: www.cntxt.tech. Details can change; the platform's page is the final word. How we check listings.
