Applied Computer Science Benchmark Specialist

Weekday

United StatesContract & freelance
This role is for one of our clients Compensation: $66 - $84 per hour We are seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. In this role, you will develop and validate rigorous multiple-choice questions across a broad ra

About the role

This role is for one of our clients

Compensation: $66 - $84 per hour

We are seeking experienced computer science professionals to author and review high-quality academic assessment content for an AI research initiative. In this role, you will develop and validate rigorous multiple-choice questions across a broad range of computer science domains, assess solution quality, and help establish gold-standard benchmarks for evaluating advanced AI systems.

You will contribute through one of two primary task types:

Question Authoring — Develop original, challenging multiple-choice questions within your area of computer science expertise, assess their difficulty, and submit them for review.

Question Verification — Review existing questions for technical accuracy, clarity, completeness, and rigor. Make necessary edits, assess difficulty, and document the rationale behind your changes.

Requirements

Computer Science Domains

Accelerator / GPU Kernel Engineering

Formal Methods & Automated Reasoning

Computer Architecture & Accelerators

Distributed Systems

DevOps & Site Reliability Engineering

Data Engineering & Databases

Cloud Computing & Infrastructure

Operating Systems & Systems Kernel

Machine Learning Engineering

Web & API Development

Embedded Systems Engineering

Computer Graphics & Game Development

Mobile Engineering

Key Responsibilities

Create original computer science questions that evaluate deep conceptual understanding, technical reasoning, and problem-solving rather than surface-level recall.

Ensure every question is unambiguous, self-contained, technically accurate, and sufficiently specified for a qualified expert to solve.

Classify questions by difficulty:

Medium: Introductory undergraduate level

Hard: Advanced undergraduate level

Expert: Postgraduate level and above

Provide one correct answer alongside nine plausible but subtly incorrect alternatives designed to distinguish strong technical reasoning from superficial knowledge. …

Official source: apply.workable.com. Details can change; the platform's page is the final word. How we check listings.

Similar roles