Logo for Hippocratic AI

RN Clinical Data Annotation Specialist

Role overview

Qualifications

  • Active, unrestricted RN license in the United States. Compact license preferred.
  • Minimum 5 years of hands-on clinical experience (bedside nursing, case management, clinical quality/utilization review, clinical nurse educators, or equivalent).
  • Strong clinical judgment and working knowledge of evidence-based protocols and clinical practice guidelines.
  • Strong written communication skills for documenting feedback and corrections clearly.

Responsibilities

  • Review recorded and simulated AI agent interactions across a variety of clinical use cases, applying sound clinical judgment to assess the accuracy, safety, and appropriateness of agent responses.
  • Score and annotate agent performance using structured evaluation rubrics, aligning with evidence-based protocols and clinical practice guidelines.
  • Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.
  • Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.

Key facts

  • Remote from: United States
  • Fixed term
  • Senior (5-10 years)
  • Data Annotation Specialist
  • English

Hard skills

Other skills

  • Detail Oriented

About the company

Hippocratic AI logo

Hippocratic AI

Digital Health & Health Tech

Hippocratic AI is building a safety focused large language model (LLM) for the healthcare industry. We believe that generative AI has the potential to massively increase healthcare access the world over but has to be built and tested responsibly. Like the Hippocratic oath that doctors take we are building a model that aims to “Do no Harm.” Hippocratic AI’s model is tuned for the healthcare industry in three ways: 1. Certifications: It was trained to pass not just the USMLE but rather to pass 114 different detailed certifications. Furthermore, beat open AI’s GPT-4 on 105 of the certifications (tied on 6 and only lost on 3) 2. Bedside Manner: Specifically trained to have a great bedside manner. In healthcare delivery, how you say something to a patient is as important as what you say. The company developed a novel benchmark and beat all other commercial LLMs on this measure of bedside manner. 3. RHLF’d by Healthcare Professionals: RLHF is the process of tuning a model and is a technique credited with must of the success of ChatGPT. Hippocratic is using the exact healthcare professions that conduct each role today to QA and train the model. The company raised a $50MM seed round from is A16z and General Catalyst and is founded by hospital administrators, doctors, medicare experts, and LLM researchers.

Company details

Company typeStartup
IndustryDigital Health & Health Tech
Company size11 - 50

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the Role

We are seeking Registered Nurses with at least 5 years of clinical experience — bedside nursing, case management, clinical nurse educators, or clinical quality — to join our internal data annotation team evaluating AI-driven clinical agents. You will review agent conversations spanning primary care, chronic disease management, care management, medication adherence, and scheduling, labeling and annotating for clinical accuracy, safety, and guideline adherence. This is a remote, contract position (1099). We are open to individuals available for 20 to 40 hours/week with flexible scheduling.

Key Responsibilities

  • Review recorded and simulated AI agent interactions across a variety of clinical use cases, applying sound clinical judgment to assess the accuracy, safety, and appropriateness of agent responses.

  • Score and annotate agent performance using structured evaluation rubrics, aligning with evidence-based protocols and clinical practice guidelines.

  • Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.

  • Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.

  • Participate in periodic calibration sessions with other clinical reviewers to ensure consistent annotation standards.

Qualifications

  • Active, unrestricted RN license in the United States. Compact license preferred.

  • Minimum 5 years of hands-on clinical experience (bedside nursing, case management, clinical quality/utilization review, clinical nurse educators, or equivalent).

  • Strong clinical judgment and working knowledge of evidence-based protocols and clinical practice guidelines.

  • Comfortable reviewing written transcripts and applying structured rubrics with a high level of attention to detail.

  • Strong written communication skills for documenting feedback and corrections clearly.

  • Able to work independently and meet turnaround expectations.

Recommended

It is not a requirement that candidates have all of the recommended criteria

  • Prior experience in clinical quality assurance, utilization review, or case review.

  • Experience with chart audits or clinical documentation review.

  • Familiarity with AI-assisted clinical tools or digital health platforms.

Engagement Details

  • Contract (1099) position, 20-40 hrs per week.

  • Fully remote; flexible scheduling.

  • Hourly compensation, commensurate with experience.

Why Join Hippocratic AI

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Equal Opportunity

Hippocratic AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity or expression, genetic information, military or veteran status, or any other characteristic protected by applicable law. We are committed to building a team that reflects the patients we serve. We actively encourage applications from candidates of all backgrounds. If you require accommodations during the hiring process, please contact people@hippocraticai.com.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Data Annotation Specialist Related jobs

Other jobs at Hippocratic AI

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.