We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.

È il candidato/la candidata ideale per questa opportunità? Lo scopra leggendo la panoramica del ruolo qui sotto.
Key Responsibilities:

-

- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.

- Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.

- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.

- Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.

- Provide detailed feedback on model behavior to improve personalization performance.

Required Skills & Qualifications:

-

- English proficiency with a high degree of competence in reading and writing.





- Experience in prompt engineering or designing test cases for AI models.

- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.

- Familiarity with personalization concepts and evaluation metrics in AI systems.

- Attention to detail to identify subtle discrepancies in model outputs.

- Willingness to use your primary personal Google account and enable personal data sources for assessment.

- Full-time availability in your local time zone to support a global, 24-hour operations team.

More About the Opportunity:

This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. xysqume

#J-18808-Ljbffr
Per questa posizione sono disponibili opzioni di lavoro a distanza/a casa.

📌 Quality Analyst (Remote) (Italia)
🏢 Hire Feed
📍 Italia