Logo for ModMed

Machine Learning Engineer

Role overview

Qualifications

  • 3+ years of experience in Machine Learning with a strong focus on AI agents and conversational NLP systems.
  • Proven experience building autonomous systems using LangGraph, AutoGen, CrewAI, or similar no-code/low-code agent frameworks.
  • Hands-on experience with AWS and Databricks, including building CI/CD pipelines for deploying machine learning models and AI agents.
  • Strong proficiency in Python and experience with modern evaluation frameworks such as RAGAS or DeepEval.

Responsibilities

  • Design and deploy multi-agent systems to execute complex clinical workflows.
  • Build and optimize conversational AI interfaces for patient engagement.
  • Implement evaluation frameworks to measure model and agent performance.
  • Create and maintain dashboards to monitor agent reasoning traces and system performance.

About the company

ModMed logo

ModMed

ModMed is transforming healthcare by placing doctors and patients at the center of care through an intelligent, specialty-specific cloud platform. With our electronic health records (EHR) and practice management (PM) systems, and our revenue cycle management (RCM) services, our all-in-one solution empowers specialty medical practices to do their best work by providing them with clinical, financial and operational software solutions designed to enable better, more personalized patient care. Our staff physicians help to develop products and services for dermatology, gastroenterology, ophthalmology, orthopedics, otolaryngology, pain management, plastic surgery, podiatry and urology practices, as well as ambulatory surgery centers. For more information, visit www.modmed.com.

Company details

Company typeLarge
Company size1001 - 5000

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Join the Team Modernizing Medicine

At ModMed, we’re not just building software—we’re reimagining the healthcare experience. Founded in 2010 by a practicing physician and a successful tech entrepreneur, we took a radically different approach: we hired doctors and taught them how to code. This "for doctors, by doctors" philosophy has allowed us to create an AI-enabled, specialty-specific cloud platform that places patients at the center of care.

A Culture of Excellence

When you join ModMed, you’re joining an award-winning team recognized for innovation and employee satisfaction.   From our global headquarters in Boca Raton Florida, and extensive employee base in Hyderabad India, we are a team of 4,500+ passionate problem-solvers on a mission to increase medical practice success and improve patient outcomes:

  • Consistently ranked as a Top Place to Work

  • 2025 Globee Business Awards: Gold Globee for “Technology Team of the Year”

  • 2025 Black Book Awards: Ranked #1 EHR in 11 Specialties

  • Florida Venture Forum: Venture-Backed Company of the Year

We are growing fast, thinking big, and we are just getting started.

Ready to modernize medicine with us?

Job Description Summary:

We are seeking a Machine Learning Engineer to build the “active brain” of our patient engagement platform. In this role, you will develop autonomous and conversational AI agents capable of triaging patient messages and managing clinical workflows.

Your mission is to design systems that don’t just respond, but act—executing complex tasks with minimal human intervention while maintaining high standards of safety, empathy, and accuracy.

What you'll do

  • Autonomous Agent Development
    Design and deploy multi-agent systems using frameworks such as LangGraph, AutoGen, CrewAI, or no-code/low-code agent frameworks to execute complex, non-linear clinical workflows.

  • Patient Engagement Agents
    Build and optimize conversational AI interfaces that handle message triage, sentiment analysis, and context-aware responses that are natural, empathetic, and patient-centric. Develop tool-calling architectures that enable AI agents to interact with external APIs, EHR systems, and databases to perform real-world actions.

  • Model & Agent Evaluation
    Design and implement evaluation frameworks to measure model and agent performance, including accuracy, reliability, safety, and task completion. Continuously improve systems using structured evaluation methodologies and feedback loops.

  • Safety & Guardrails
    Implement robust evaluation pipelines and guardrails (e.g., NeMo Guardrails) to ensure agent safety, clinical accuracy, and HIPAA compliance.

  • AI Observability
    Create and maintain dashboards to monitor agent reasoning traces, system performance, uptime, and task completion rates in production environments.

What you'll bring

  • 3+ years of experience in Machine Learning with a strong focus on AI agents and conversational NLP systems.

  • Proven experience building autonomous systems using LangGraph, AutoGen, CrewAI, or similar no-code/low-code agent frameworks.

  • Hands-on experience with fine-tuning models and implementing rigorous evaluation frameworks to ensure agent performance, safety, and reliability. Familiarity with techniques for detecting hallucinations, bias, and failure modes in agent behavior.

  • Strong understanding of guardrails, alignment techniques, and safety mechanisms to ensure compliant, accurate, and trustworthy agent outputs in sensitive environments.

  • Hands-on experience with AWS and Databricks, including building CI/CD pipelines for deploying machine learning models and AI agents.

  • Strong proficiency in Python and experience with modern evaluation frameworks such as RAGAS or DeepEval.

ModMed Benefits Highlight:  At ModMed, we believe it’s important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce. Eligible Modernizers can enroll in a wide range of benefits:

United States

  • Comprehensive medical, dental, and vision benefits, including a company Health Savings Account contribution,
  • 401(k):  ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation. After one year of employment with ModMed, 100% of any matching contribution you receive is yours to keep.
  • Generous Paid Time Off and Paid Parental Leave programs,
  • Company paid Life and Disability benefits, Flexible Spending Account, and Employee Assistance Programs,
  • Company-sponsored Business Resource & Special Interest Groups that provide engaged and supportive communities within ModMed,
  • Professional development opportunities, including tuition reimbursement programs and unlimited access to LinkedIn Learning,
  • Global presence and in-person collaboration opportunities; dog-friendly HQ (US), Hybrid office-based roles and remote availability for some roles,
  • Weekly catered breakfast and lunch, treadmill workstations, Zen, and wellness rooms within our BRIC headquarters.

PHISHING SCAM WARNING: ModMed is among several companies recently made aware of a phishing scam involving imposters posing as hiring managers recruiting via email, text and social media. The imposters are creating misleading email accounts, conducting remote "interviews," and making fake job offers in order to collect personal and financial information from unsuspecting individuals. Please be aware that no job offers will be made from ModMed without a formal interview process, and valid communications from our hiring team will come from our employees with a ModMed email address (first.lastname@modmed.com). Please check senders’ email addresses carefully.  Additionally, ModMed will not ask you to purchase equipment or supplies as part of your onboarding process. If you are receiving communications as described above, please report them to the FTC website.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Machine Learning Engineer Related jobs

Other jobs at ModMed

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.