Logo for Patronus AI

Domain Expert (Contract)

Role overview

Qualifications

  • 3+ years of relevant professional experience or substantial research experience
  • Strong professional judgment
  • Clear writing and ability to explain complex ideas
  • Professional fluency in English

Responsibilities

  • Answer questions about workflows, decisions, and challenges
  • Develop realistic scenarios based on professional experience
  • Review work for accuracy and clarity
  • Help define quality standards and assess work

Key facts

  • Remote from: United States
  • Fixed term
  • Mid-level (2-5 years)
  • English

Hard skills

Other skills

  • Professional Responsibility
  • Writing
  • Detail Oriented
  • Teaching
  • Research
  • Lateral Thinking
  • Curiosity
  • Ability To Meet Deadlines

About the company

Patronus AI logo

Patronus AI

IT Services & IT Consulting

Patronus AI is the leading automated AI evaluation and security company. Our world-class platform enables enterprise development teams to score LLM performance, generate adversarial test cases, benchmark LLMs, and more. Customers use Patronus AI to detect LLM mistakes at scale and deploy AI products safely and confidently. Founded by machine learning experts from Meta AI and Meta Reality Labs, Patronus AI is on a mission to boost enterprise confidence in generative AI. We are backed by Lightspeed Venture Partners, Replit CEO Amjad Masad, Gokul Rajaram, and Fortune 500 executives and board members.

Company details

Company typeStartup
IndustryIT Services & IT Consulting
Company size11 - 50

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Patronus AI

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.

We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.

About the roleWe’re looking for experienced professionals to help improve how AI understands and performs real-world work. You’ll share your expertise, contribute to realistic scenarios, and review work for accuracy and quality.

Projects vary, but all require clear thinking, sound professional judgment, and attention to detail. No prior AI or machine learning experience is required.

What you’ll do

Depending on the project, you may:

  • Answer questions about the workflows, decisions, and challenges in your field.
  • Develop realistic scenarios and problems grounded in your professional experience.
  • Provide clear explanations, reference answers, and supporting examples.
  • Help define quality standards and assess work against them.
  • Test and refine content to reflect real-world complexity.
  • Review other contributors’ work for accuracy, clarity, and practical relevance.
  • Incorporate feedback promptly and flag gaps or unclear guidance.

What we’re looking for

  • 3+ years of relevant professional experience, or substantial research experience in your field.
  • Strong professional judgment and the ability to spot subtle errors or gaps in reasoning.
  • Clear writing and the ability to explain complex ideas in straightforward terms.
  • Careful attention to detail and a habit of checking your own work.
  • Curiosity and a willingness to question assumptions.
  • Comfort using spreadsheets, structured templates, and everyday digital tools.
  • Ability to work independently, respond to feedback, and meet deadlines.
  • Professional fluency in English.

We welcome experts across finance, law, medicine, engineering, science, mathematics, software, writing, and other professional fields.

Nice to have

  • Experience teaching, conducting research, publishing, or designing assessments.
  • Experience reviewing others’ work or providing structured feedback.
  • Previous involvement in AI training, evaluation, or similar projects.

Our standards

  • Original, human-authored work grounded in your expertise.
  • No copying or repackaging existing questions or published solutions.
  • Accurate, carefully checked contributions.
  • Quality over volume.

Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

By clicking ‘Apply’, you agree to Greenhouse's Terms of Service and Privacy Policy.

By clicking 'Apply', you agree to Patronus AI, Inc. Privacy Policy.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at Patronus AI

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.