Key Facts

Remote From:

New York (USA)

Category: Quality Assurance Specialist

Part time

English

Hard Skills

Online Communication User Feedback AI Testing Model Validation Annotation Processing

Other Skills

•
Detail Oriented
•
Quality Assurance
•
Time Management
•
Problem Solving
•
Social Skills

Roles & Responsibilities

Strong attention to detail and ability to apply evaluation rubrics consistently and objectively.
Excellent written communication skills; able to document findings clearly and provide actionable feedback.
2+ years of experience in QA, editing, reviewing, auditing, or annotation work (any domain).
Basic ability to work independently and manage one's time.

Requirements:

Review and validate image datasets sourced from external vendors against defined quality standards and QA rubrics.
Identify inconsistencies, labeling errors, and systematic quality failures. Provide structured written feedback.
Contribute to the development of instruction specs and golden sample datasets as internal quality benchmarks.
Collaborate with Researchers and Ops teams to scope data projects, define quality criteria, and support evaluation efforts.

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Image QA Expert
Type: Contract
Compensation: $50–$60/hour
Location: Remote

Role Responsibilities

Review and validate image datasets sourced from external vendors against defined quality standards and QA rubrics.
Identify inconsistencies, labeling errors, and systematic quality failures. Provide structured written feedback.
Contribute to the development of instruction specs and golden sample datasets as internal quality benchmarks.
Collaborate with Researchers and Ops teams to scope data projects, define quality criteria, and support evaluation efforts.
Work independently and manage time effectively to meet deadlines while ensuring high-quality image data.

Qualifications

Must-Have

Strong attention to detail and ability to apply evaluation rubrics consistently and objectively.
Excellent written communication skills; able to document findings clearly and provide actionable feedback.
2+ years of experience in QA, editing, reviewing, auditing, or annotation work (any domain).
Basic ability to work independently and manage one's time.
Verbal and written communication skills, problem-solving skills, and interpersonal skills.

Preferred

Past experience in AI training, model evaluation, or data annotation.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Ready to apply?

APPLY

Share ·