Overview
As an Expert Rater (ER), you will specialize in providing Rater's support and guidance. You will be instrumental in enhancing the knowledge and skills of other Raters, with a particular focus on developing their rating expertise. Your responsibilities include facilitating client test rounds, understanding templates and workflows, cascading quality expectations to the broader Raters team, and actively monitoring progress and deliverables to meet client expectations. Additionally, you will play a key role in coaching and mentoring Raters, ensuring they gain the necessary skills to improve rating accuracy and decision-making. Your expertise will contribute to elevating the overall quality of our AI-powered advertising systems.
Main Responsibilities
- Support Raters in skill development, guiding them in best practices for accurate and consistent ratings.
- Ensure annotation selection and gold set creation adhere to template instructions, guaranteeing unbiased outcomes that are reached through elaborate peer-driven consensus.




- Analyze diverse datasets to identify significant patterns and trends, demonstrating proficiency in interpreting and utilizing KPIs to drive data-informed decision-making.
- Employ strategic questioning techniques to gather information, enhance understanding, and stimulate critical thinking for effective problem-solving and decision-making.
- Craft written materials such as emails, questions, and feedback specifically customized for client communication, ensuring clarity and relevance.
- Facilitate information or concepts to audiences using relevant documentation and clear communication strategies to align with specific client objectives.
- Collaborate with research and development teams in experiments aimed at enhancing the client’s data.
- Work closely with clients and CEM to conduct test rounds, gain insights into their requirements, and understand the quality benchmarks expected.
- Conduct evaluations independently to sustain and enhan

📌 Expert Rater Project (Italia)
🏢 Welo Global
📍 Italia