About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Scorra la pagina per visualizzare tutti i requisiti del lavoro e le responsabilità che i candidati selezionati dovranno assumersi.

Position: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote

Role Responsibilities

- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF , SFT , and AI safety benchmarking .
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.




- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety , Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English , critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Preferred
- Experience with AI Safety , RLHF , SFT , Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development. xlwpduy
- Experience reviewing complex, high-risk, or ambiguous content.

#J-18808-Ljbffr

📌 AI Safety Specialist - Evaluation Expert (Milano)
🏢 Mercor
📍 Milano