CS PhD - AI Benchmark Specialist

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Applied Computer Science Benchmark Specialist
Type: Contract
Compensation: $66–$84/hour
Location: Remote
Commitment: 10+ hours/week

Role Responsibilities

• Author original computer science questions that test deep conceptual understanding. Ensure questions are unambiguous, self-contained, and precisely defined.
• Rate each question's difficulty as Medium, Hard, or Expert. Provide one correct answer and nine plausible but subtly incorrect alternatives.
• Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format. Supply 1–5 academic references per question from reputable sources.
• Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.
• Flag issues with clarity, completeness, precision, or solvability in verification tasks. Justify any edits made.

Qualifications

Must-Have

• PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field.
• Master's degree considered for candidates with exceptional depth in a specific subdomain.
• Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
• Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

• Research publications, industry experience at top tech companies, or competitive programming background is a strong plus.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.