IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position , open to candidates based in Italy.
Pay: $40–$90/hr
Role Title: Research Evaluation Specialist (PhD / Researcher / Professor)
Role Type: Contractor
Location: Remote
We are engaging Research Evaluation Specialists (PhD / Researcher / Professor) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
- Source, verify,



and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.

Preferred Qualifications
- PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, or professor in your domain.
- Demonstrated track record of scholarly research, in-depth subject matter expertise, and famil

📌 Research Evaluation Specialist (Roma)
🏢 RemoteJobsOne
📍 Roma