Logo for Mercor

UI/UX Design Expert - Evaluator - AI Trainer

Role overview

Qualifications

  • 5+ years of professional experience in product design, UI/UX, or design systems
  • Background at leading digital-product and UX studios or in-house product-design teams
  • Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing
  • Deep fluency in interaction and visual design, design systems, and Figma

Responsibilities

  • Design precise, task-specific grading criteria for real-world digital product and UX deliverables
  • Score AI-generated and human work samples against criteria with detailed written justifications
  • Apply consistent, evidence-based judgment for reproducible and defensible scores
  • Incorporate structured feedback from senior reviewers and iterate quickly on work

Key facts

  • Remote from: New Jersey (USA)
  • Part time
  • Senior (5-10 years)
  • UI/UX Designer
  • English

Hard skills

Other skills

  • Detail Oriented

About the company

Mercor logo

Mercor

  • Job Boards & Talent Marketplaces
  • 51–200
Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone. Today, more than 30,000 experts in our network collectively earn over $2 million a day.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world digital product and UX deliverables.
  • Score AI-generated and human work samples against criteria with detailed written justifications.
  • Apply consistent, evidence-based judgment for reproducible and defensible scores.
  • Incorporate structured feedback from senior reviewers and iterate quickly on work.
  • Work independently and asynchronously to evaluate and improve AI model performance.

Qualifications

Must-Have

  • 5+ years of professional experience in product design, UI/UX, or design systems.
  • Background at leading digital-product and UX studios or in-house product-design teams.
  • Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.
  • Deep fluency in interaction and visual design, design systems, and Figma.
  • Exceptionally strong written communication skills.
  • Detail-oriented and comfortable with peer-reviewed judgment.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background.
  • Qualified applicants may complete a brief assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.



#hiringmercor

Related jobs

See all UI/UX Designer jobs

Other jobs at Mercor