Audio Evaluator - AI Trainer

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: English (New Zealand) Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Commitment: 10–20 hours/week

Role Responsibilities

• Transcribe and optimize audio and video content in English (New Zealand), ensuring clarity and adherence to guidelines.
• Develop and document evaluation standards, including rubrics and grading guidelines in English.
• Conduct model testing and grading, providing feedback to improve model performance in New Zealand English audio tasks.
• Support benchmarking and quality assurance to maintain consistency and reliability in datasets.
• Collaborate with project leads to resolve ambiguities and enhance task design.

Qualifications

Must-Have

• Strong writing, editing, and critical thinking skills.
• Ability to work independently and meet deadlines.
• Native or near-native fluency in English (New Zealand).
• Familiarity with New Zealand English, regional vocabulary, and Māori influences.
• Available to commit 10–20 hours/week.

Preferred

• College students or recent graduates.
• Background in linguistics, humanities, or social sciences.
• Experience with transcription, annotation, or localization.
• Interest in AI and language models.

Application Process (Takes 20–30 mins to complete)

• Complete a short AI-led interview (approximately 15 minutes).
• If selected, you will be onboarded and invited to begin project work.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.