Conversation Quality Analyst (AI Training) About The Role What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to review and evaluate AI-generated dialogues — helping ensure that AI sounds genuinely helpful, natural, and human. This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how language works.

No background in AI, linguistics, or tech required — just a reliable internet connection and a commitment to thoughtful, consistent work.

Organization: Alignerr

Type: Hourly Contract

Location: Remote

Commitment: 10–40 hours/week What You'll Do Read and evaluate AI-generated conversations across a wide range of topics and scenarios

Rate dialogue quality on dimensions like naturalness, helpfulness, tone, and relevance

Identify awkward phrasing, off-topic responses, logical errors, or unnatural flow

Compare multiple conversation paths and rank them by overall quality

Submit structured, detailed evaluations using provided rubrics and rating tools





Work independently and asynchronously on your own schedule Who You Are Strong reading comprehension and an intuitive sense of how natural conversation flows

Able to assess dialogue quality objectively and articulate your reasoning clearly

Detail-oriented and consistent — you apply the same standard across many evaluations

Comfortable working through large volumes of text-based content

Self-motivated and reliable when working independently

No AI, linguistics, or content moderation experience required Nice to Have Background in writing, editing, communications, or customer service

Experience with quality assurance, research, or critical analysis

Familiarity with AI chatbots or conversational tools as an end user Why Join Us Work on cutting-edge AI projects alongside leading research labs

Fully remote and flexible — work when and where it suits you

Freelance autonomy with the structure of meaningful, task-based work

Contribute to AI development that directly shapes how technology communicates with the world

Potential for ongoing work and contract extension as new projects launch

📌 Conversation Quality Analyst (Italia)
🏢 Alignerr
📍 Italia