Logo for Hippocratic AI

RN/NP Clinical Quality Reviewer

Role overview

Qualifications

  • Active, unrestricted RN license in the United States
  • Active, unrestricted NP license in the United States with current board certification
  • Hands-on professional experience in clinical triage or managing hypertension/CHF

Responsibilities

  • Review recorded and simulated AI agent interactions for acute symptom triage accuracy
  • Evaluate AI conversations for hypertension, CHF management, and medication titration
  • Review diabetes management conversations for clinical accuracy and guideline adherence
  • Identify clinical safety concerns and provide actionable feedback for agent refinement

Key facts

Hard skills

Other skills

  • Teamwork
  • Detail Oriented

About the company

Hippocratic AI logo

Hippocratic AI

Digital Health & Health Tech

Hippocratic AI is building a safety focused large language model (LLM) for the healthcare industry. We believe that generative AI has the potential to massively increase healthcare access the world over but has to be built and tested responsibly. Like the Hippocratic oath that doctors take we are building a model that aims to “Do no Harm.” Hippocratic AI’s model is tuned for the healthcare industry in three ways: 1. Certifications: It was trained to pass not just the USMLE but rather to pass 114 different detailed certifications. Furthermore, beat open AI’s GPT-4 on 105 of the certifications (tied on 6 and only lost on 3) 2. Bedside Manner: Specifically trained to have a great bedside manner. In healthcare delivery, how you say something to a patient is as important as what you say. The company developed a novel benchmark and beat all other commercial LLMs on this measure of bedside manner. 3. RHLF’d by Healthcare Professionals: RLHF is the process of tuning a model and is a technique credited with must of the success of ChatGPT. Hippocratic is using the exact healthcare professions that conduct each role today to QA and train the model. The company raised a $50MM seed round from is A16z and General Catalyst and is founded by hospital administrators, doctors, medicare experts, and LLM researchers.

Company details

Company typeStartup
IndustryDigital Health & Health Tech
Company size11 - 50

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

RN/NP Clinical Quality Reviewer

Primary Care, Acute Symptom Triage & Travel Health | Contract, up to 25 hrs/week

About the Role

We are seeking Nurses & Nurse Practitioners with clinical experience in one or more of the following areas:

  • Telephone or virtual acute symptom triage

  • Hypertension and congestive heart failure (CHF) management

  • Medication titration for hypertension and/or CHF

  • Diabetes management and insulin titration

  • Travel health

to serve as a subject matter expert supporting the evaluation of AI-driven clinical agents. In this role, you will evaluate agent conversations and recommendations spanning acute symptom triage and escalation decisions, insulin/diabetes titration, and pre-travel health guidance, ensuring clinical accuracy, guideline adherence, and patient safety. This is a part-time, remote contract position (1099) requiring up to 25 hours per week, with flexible scheduling.

Key Responsibilities

  • Review recorded and simulated AI agent interactions involving acute symptom triage and assess the appropriateness of triage, escalation, and de-escalation decisions.

  • Evaluate AI agent conversations involving hypertension and CHF management, including medication titration, for clinical accuracy and adherence to evidence-based protocols.

  • Review agent conversations related to diabetes management and insulin titration for clinical accuracy and guideline adherence.

  • Evaluate agent-delivered travel health guidance, including pre-travel counseling, vaccination recommendations, and destination-specific risk assessment.

  • Review AI agent calls for adherence to established clinical protocols and appropriate medical management.

  • Score and annotate agent performance using structured evaluation rubrics.

  • Perform clinical data annotation by rewriting or correcting AI agent responses to align with evidence-based protocols and clinical practice guidelines.

  • Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.

  • Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.

  • Participate in periodic case review and calibration sessions with other clinical SMEs to ensure consistent evaluation standards.

  • Help develop and refine test scenarios used in ongoing agent quality assurance.

Qualifications

  • Registered Nurses: Active, unrestricted RN license in the United States.

  • Nurse Practitioners: Active, unrestricted NP license in the United States, with current board certification (ANCC or AANP).

  • Hands-on professional experience conducting protocol-based virtual or telephone clinical triage; and/or

  • Hands-on clinical experience directly managing patients with hypertension and/or congestive heart failure (CHF).

  • For candidates with hypertension/CHF management experience, hands-on experience prescribing, adjusting, or titrating medications for these patients.

  • Strong working knowledge of evidence-based protocols and clinical practice guidelines relevant to acute triage and/or hypertension and CHF management.

Recommended

It is not a requirement that candidates have all of the recommended criteria

  • Experience in telephone triage or nurse advice line settings.

  • Experience in travel medicine, occupational health, or pre-travel consultation.

  • Familiarity with CDC and other travel medicine guidelines.

  • Prior experience in clinical quality assurance, utilization review, or case review.

  • Familiarity with AI-assisted clinical tools or digital health platforms.

Engagement Details

  • Contract (1099) position, up to 25 hours per week.

  • Fully remote; flexible scheduling.

  • Hourly compensation, commensurate with experience.

  • Engagement expected to run in support of ongoing agent development and FDA evaluation milestones.

Why Join Hippocratic AI

Reinvent healthcare with AI that puts safety first. We’re building the world’s first healthcare‑only, safety‑focused LLM — a breakthrough platform designed to transform patient outcomes at a global scale. This is category creation.

Work with the people shaping the future. Hippocratic AI was co‑founded by CEO Munjal Shah and a team of physicians, hospital leaders, AI pioneers, and researchers from institutions like El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft, and NVIDIA.

Backed by the world’s leading healthcare and AI investors. We recently raised a $126M Series C at a $3.5B valuation, led by Avenir Growth, bringing total funding to $404M with participation from CapitalG, General Catalyst, a16z, Kleiner Perkins, Premji Invest, UHS, Cincinnati Children’s, WellSpan Health, John Doerr, Rick Klausner, and others.

Build alongside the best in healthcare and AI. Join experts who’ve spent their careers improving care, advancing science, and building world‑changing technologies — ensuring our platform is powerful, trusted, and truly transformative.

Equal Opportunity

Hippocratic AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, national origin, sex, age, disability, sexual orientation, gender identity or expression, genetic information, military or veteran status, or any other characteristic protected by applicable law. We are committed to building a team that reflects the patients we serve. We actively encourage applications from candidates of all backgrounds. If you require accommodations during the hiring process, please contact people@hippocraticai.com.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at Hippocratic AI

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.