Logo for Welo Data

English (Canada) Audio Rater

Role overview

Qualifications

  • Strong listening and attention-to-detail skills
  • Ability to give consistent, well-reasoned ratings
  • Clear, concise written communication
  • Reliable availability for ~10 hours/week

Responsibilities

  • Listen carefully to recorded conversations between a person and an AI voice agent
  • Rate each of the agent's turns on two independent 1–5 scales: Content and Prosody
  • Write a short, specific, and clear justification for each score given

Key facts

Hard skills

Other skills

  • Active Listening
  • Detail Oriented
  • Reliability

About the company

Welo Data logo

Welo Data

IT Services & IT Consulting

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span: - Annotation and Labeling: Transcription, summarization, image and video classification and labeling. - Enhancing LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking. - Data Collection and Generation: From institutional languages to remote field audio collection. - Relevance and Intent: Authoritative relevance solutions across any discovery target, with mature operating models and a highly trained global workforce. - The Welo Data advisory team members bring practical, applied AI expertise to your projects. They have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Elevate your Data with Welo Data.

Company details

Company typeLarge
IndustryIT Services & IT Consulting
Company size1001 - 5000

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Overview:

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

Project Details:

Start Date: ASAP

Duration: 10 hours/week

Job Type: Freelance

Location: Remote (Canada)

Language: English(Canada)

Pay Rate: US$26/hour

What You'll do:

  • Listen carefully to recorded conversations between a person and an AI voice agent
  • Rate each of the agent's turns on two independent 1–5 scales:
    • Content – Was the response helpful, relevant, and appropriate?
    • Prosody – Did the voice sound natural, well-paced, and expressive?
  • Write a short, specific, and clear justification for each score given

What We're Looking For:

  • Strong listening and attention-to-detail skills
  • Ability to give consistent, well-reasoned ratings
  • Clear, concise written communication
  • Reliable availability for ~10 hours/week

Thank you for your interest in joining Welo Data's community and contributing to this exciting project. We look forward to collaborating with you!

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at Welo Data

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.