Mercor is looking for a Bilingual Italian STEM Expert with experience in biology / physics / chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology / physics / chemistry will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate Italian/English prompts and responses, ensuring scientific precision while maintaining clear, natural Italian phrasing and alignment with English where needed.
Job Details
- Design and Optimize STEM-Based Prompts (Bilingual): Create detailed prompts in Italian and/or English with multiple constraints and scientific instructions.
- Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in Italian—linguistic clarity and appropriate academic tone.
- Conduct Model Testing and Grading (Bilingual):
Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing Italian vs. English where needed.
- Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across Italian-language benchmarks before integration into official benchmarks.
Minimum Qualifications
- Native-level fluency in Italian (written) with strong reading/writing ability in English
- BS or BA in Biology / Physics / Chemistry
- Familiarity with undergraduate-level biology / physics / chemistry topics
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
Preferred Qualifications
- 2+ years of experience in teaching, research, or an applied STEM discipline field
Application & Onboarding Process
- Complete an AI-led interview (around 15 minutes)
- Complete a 45-minute written
📌 Bilingual Italian Stem Expert (Milano)
🏢 Mercor
📍 Milano
Candidati a questo annuncio
Mostra le tue capacità professionali all'azienda, compila il form e lascia un tocco personale nella lettera di presentazione, aiuterà il recruiter nella scelta del candidato.