Role overview

Qualifications

Currently a PGY-1 resident in a US medical residency program (MD or DO).
Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 and 2.
Prior experience in medical education content review.
Strong understanding of medical education pedagogy and learning outcomes.

Responsibilities

Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum.
Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility.
Provide expert feedback to ensure content meets the learning needs of first and second-year medical students.
Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload).

Key facts

Remote from: North America
Full time
Entry-level / graduate
Editor / Proofreader
115 - 115K yearly
English

Hard skills

General Science Educational Evaluation International Medical Education Directory Learning Platforms

Other skills

Time Management
Detail Oriented
Reliability
Communication

About the company

Osmosis.org from Elsevier

E-Learning / EdTech

Osmosis.org is a leading health education platform with an audience of millions of current and future healthcare professionals and their patients and family members (https://www.osmosis.org/world). Our vision is to create a more caring world by developing the most caring people. To learn more please visit www.osmosis.org/about and to see what career opportunities are available please visit www.osmosis.org/careers.

Company details

Company typeScaleup

IndustryE-Learning / EdTech

Company size51 - 200

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Position Overview

We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation.

Primary Responsibilities

Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum

Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility

Provide expert feedback to ensure content meets the learning needs of first and second-year medical students

Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload)

Participate in quarterly evaluation cycles with potential for ad-hoc assessments

Required Qualifications

Candidates must meet ONE of the following criteria:

Current PGY-1 resident in a US medical residency program (MD or DO degree), OR

Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2

Preferred Qualifications

Prior experience in medical education content review

Strong understanding of medical education pedagogy and learning outcomes

Time Commitment

5-15 hours per week during active evaluation periods

Minimum of 4 evaluation cycles per year

Project Details

Duration: November 2025 – December 2026 (with possibility of extension)

Start Date: First evaluation round begins November 5, 2025

Compensation: $60 USD per hour

Work Arrangement: Remote (US time zones)

Contract Structure: Employment through third-party contracting agency

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.