Role Title: Research Evaluation Specialist (PhD or Masters / Researcher) Role Type: Contractor (~15 hs a week) Location: Remote, worldwide micro1 is engaging Research Evaluation Specialists (PhD or Masters / Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluatio
About the role
Role Title: Research Evaluation Specialist (PhD or Masters / Researcher)
Role Type: Contractor (~15 hs a week)
Location: Remote, worldwide
micro1 is engaging Research Evaluation Specialists (PhD or Masters / Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Prior experience in AI is required while your domain knowledge brings high value.
Scope of Work
Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
Preferred Qualifications
Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor or professor in your domain.
Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
Experience sourcing and triangulating information from authoritative references. …
Official source: www.jtlabs.ai. Details can change; the platform's page is the final word. How we check listings.