pAn Enterprise client is seeking bItalian-speaking /b coding experts with JSON expertise to support the evaluation and improvement of AI-generated audio responses. /ppWork is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project. /ppExperts may work at any schedule of their choosing, for as long as tasks are available. Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines. /ppFluency in Italian is required. Experts with multilingual fluency may be offered work for this project and/or others, in additional languages /ph3Job Description /h3ulliParticipating in live, real-time conversational scenarios with AI systems /liliReviewing and labeling conversation transcripts /liliEvaluating AI-generated responses using structured rubrics and providing written justifications /liliAssessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure /liliCapturing required session artifacts, including recordings, Session IDs, and tool-call/console logs - Environment preparation and tool verification before each session.



/li /ulpExperts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence. /ph3Qualifications /h3pTo be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps. /pp"Operator" requirements: /pulliStrong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim. /liliTechnical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues /liliAudio setup: capable of producing clear audio quality with no background noise /li /ulh3Additional Information /h3pIdeal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues. /p #J-18808-Ljbffr

📌 Italian-Speaking JSON & Coders for Audio Evaluations (Italia)
🏢 Upwork
📍 Italia