pbLuogo di lavoro: /b Milanobr/AI Evaluation Specialist /p pbRole Type: /b Contractorbr/bLocation: /b Remote - US, Canada, UK, Ireland, Australia, New Zealand /p pWe are seeking experienced bAI Evaluation Specialists /b to assess and improve the quality of AI assistant outputs for an enterprise AI training project. /p pYou'll evaluate AI-generated responses using defined quality standards, identify issues, and provide clear feedback to help improve AI systems. bNo prior formal AI experience is required. /b /p h3Scope of Work /h3 ul liEvaluate AI-generated outputs against detailed rubrics for accuracy, relevance, quality, and adherence to guidelines. /li liApply consistent and objective judgment across large volumes of examples. /li liIdentify reasoning gaps, tool-use issues, logical errors, and inconsistencies. /li liProvide concise, actionable feedback highlighting strengths and areas for improvement. /li liParticipate in discussions around rubric interpretation and evolving quality standards.



/li liContribute to process improvements and evaluation best practices. /li liMaintain accurate documentation of evaluations and recommendations. /li /ul h3Preferred Qualifications /h3 ul liExperience in grading, quality assurance, editorial review, assessment, annotation, or similar analytical work. /li liAdvanced, daily use of AI assistants such as bChatGPT, Claude, or similar tools /b. /li liStrong ability to analyze complex information and communicate findings clearly in writing. /li liExperience with process improvement, rubric development, or quality assessment. /li liStrong critical-thinking skills with a focus on consistency, accuracy, and fairness. /li liComfortable working independently on high-volume evaluation tasks. /li liStrong attention to detail and ability to identify subtle quality issues. /li liCollaborative approach to resolving ambiguous cases and improving evaluation criteria. /li /ul #J-18808-Ljbffr

📌 Ai evaluation specialist - remote (Italia)
🏢 YO AI Labs
📍 Italia