Role Title: Domain Contributor - Evaluation Specialist Role Type: Contractor (~15 hrs/week) Location: Remote micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generati
About the role
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work
Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
Apply detailed task guidelines and evaluation rubrics consistently to each submission.
Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
Preferred Qualifications
Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
Advanced research skills with a track record of verifying complex claims against authoritative sources.
Exceptional written and verbal communication skills to articulate findings and feedback.
Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
Background in adversarial or “stomp the model” task design is advantageous. …
Official source: www.jtlabs.ai. Details can change; the platform's page is the final word. How we check listings.