IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position , open to candidates based in Italy.
Pay: $20–$40/hr
Role Title: Secretary & Admin Assistant
Role Type: Contractor
Location: Remote
We are engaging Secretary & Admin Assistants to contribute to a customer's project focused on designing and producing expert-authored evaluation tasks for a frontier AI benchmark. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This engagement offers the opportunity to simulate authentic administrative challenges, crafting assignments that reflect the complexity and nuance of real-world operations, and directly impact the advancement of intelligent systems.
Scope of Work
- Design realistic,



process-driven evaluation tasks that require sophisticated multi-tool coordination (e.g., calendar reconciliation, travel and expense workflows, records management, professional correspondence).
- Create and assemble authentic data artifacts, including emails, calendar entries, receipts, meeting notes, and contact records, to support each evaluation scenario.
- Define correct solutions and map out the step-by-step decisions an expert would take to achieve the best outcome in each scenario.
- Develop comprehensive rubrics (35+ criteria) that assess both process adherence and nuanced judgment calls for AI agent outputs.
- Document workflow processes and suggest improvements that reflect current best practices in the administrative domain.
- Collaborate with project leads to calibrate task complexity and ensure alignment with real-world challenges faced by experienced professionals.

Preferred Qualifications
- 5+ ye

📌 Secretary & Admin Assistant (Roma)
🏢 RemoteJobsOne
📍 Roma