Applied Legal Benchmark Specialist

Weekday

United StatesContract & freelance
This role is for one of our clients Compensation: $83-$105 per hour We are seeking experienced legal professionals to author and review high-quality academic assessment content for an AI research initiative. In this role, you will contribute your legal expertise to the development of rigorous evaluation benchmarks

About the role

This role is for one of our clients

Compensation: $83-$105 per hour

We are seeking experienced legal professionals to author and review high-quality academic assessment content for an AI research initiative. In this role, you will contribute your legal expertise to the development of rigorous evaluation benchmarks designed to assess how effectively AI systems understand and reason about complex legal concepts.

You may contribute through one of two task types:

Question Authoring: Create original, challenging multiple-choice questions within your area of legal expertise, assess their difficulty, and submit them for quality review.

Question Verification: Review existing questions for legal accuracy, clarity, completeness, and rigor. Make necessary edits, evaluate difficulty, and document the reasoning behind any changes.

Requirements

Law Domains Covered

Opportunities span a broad range of legal specialties, including:

Intellectual Property, Privacy & Technology

Regulatory & Government Affairs

Securities & Capital Markets

Financial Regulation & Compliance

Private Equity

M&A & Transaction Structuring

Antitrust, Merger Control & Competition

Healthcare, Life Sciences & Pharmaceuticals

Environmental, Energy & ESG/Climate Law

Key Responsibilities

Develop original legal questions that assess deep conceptual understanding, analytical ability, and legal reasoning rather than surface-level recall.

Ensure every question is clear, unambiguous, self-contained, and sufficiently detailed to support a definitive answer.

Classify questions by difficulty level: Medium (introductory undergraduate), Hard (advanced undergraduate), or Expert (postgraduate level and above).

Provide one correct answer along with nine plausible but subtly incorrect alternatives designed to challenge advanced legal reasoning.

Develop concise, logically structured solution explanations that demonstrate the appropriate legal reasoning process. …

Official source: apply.workable.com. Details can change; the platform's page is the final word. How we check listings.

Similar roles