Logo for Welo Data

English (New Zealand) QA Audio Rater

Welo Data

Role overview

Qualifications

  • Strong attention to detail and consistency in judgment
  • Ability to spot patterns of miscalibration and articulate clear feedback
  • Comfortable working independently during a pilot/early-stage phase
  • Prior experience in QA, auditing, or rating work is a plus

Responsibilities

  • Audit 30% of production output generated during the initial phase (Pilot)
  • Identify and flag miscalibration or inconsistent scoring across raters
  • Provide clear, actionable feedback and corrections to raters
  • Complete onboarding and training ahead of the production pool's rollout

Key facts

Hard skills

Other skills

  • Quality Assurance
  • Detail Oriented

About the company

Welo Data logo

Welo Data

IT Services & IT Consulting

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span: - Annotation and Labeling: Transcription, summarization, image and video classification and labeling. - Enhancing LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking. - Data Collection and Generation: From institutional languages to remote field audio collection. - Relevance and Intent: Authoritative relevance solutions across any discovery target, with mature operating models and a highly trained global workforce. - The Welo Data advisory team members bring practical, applied AI expertise to your projects. They have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Elevate your Data with Welo Data.

Company details

Company typeLarge
IndustryIT Services & IT Consulting
Company size1001 - 5000

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Overview:

We're looking for a QA Audio Rater to ensure rating quality and consistency during the initial phase of our audio rating program. You'll audit rater output, catch calibration issues early, and help keep the rating pool aligned and accurate.

Project Details:

Start Date: ASAP

Duration: 10 hours/week

Job Type: Freelance

Location: Remote (New Zealand)

Language: English(New Zealand)

Pay Rate: US$25/hour

What you'll do

  • Audit 30% of production output generated during the initial phase (Pilot)
  • Identify and flag miscalibration or inconsistent scoring across raters
  • Provide clear, actionable feedback and corrections to raters
  • Complete onboarding and training ahead of the production pool's rollout

What We're Looking For:

  • Strong attention to detail and consistency in judgment
  • Ability to spot patterns of miscalibration and articulate clear feedback
  • Comfortable working independently during a pilot/early-stage phase
  • Prior experience in QA, auditing, or rating work is a plus

Thank you for your interest in joining Welo Data's community and contributing to this exciting project. We look forward to collaborating with you!

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Oceania

Other jobs at Welo Data

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.