Logo for Patronus AI

Expert Manager (Contract, Remote)

Role overview

Summary

This role is for managing a group of domain experts at Patronus AI, ensuring effective communication and support. You will facilitate onboarding, monitor performance, and address issues, contributing to the overall efficiency of the expert operations team.

Qualifications

  • Experience with a contingent or freelance workforce, or moderating a technical community.
  • Fast, clear writing.
  • Ability to gain enough fluency in the domain.
  • Organised without being asked.
  • Comfort working inside internal tooling that is still being built.

Responsibilities

  • Be the consistent point of contact for the experts in your domains.
  • Own onboarding through to first accepted submission.
  • Hold performance conversations at both ends of your group.
  • Route problems to the right place.

Key facts

  • Remote from: United States
  • Fixed term
  • $96K – $288K / year
  • English

Hard skills

Other skills

  • Organizational Skills
  • Problem Solving
  • Active Listening
  • Time Management

About the company

Patronus AI logo

Patronus AI

  • AI & Machine Learning
  • Startup
  • 11–50
Patronus AI is the leading automated AI evaluation and security company. Our world-class platform enables enterprise development teams to score LLM performance, generate adversarial test cases, benchmark LLMs, and more. Customers use Patronus AI to detect LLM mistakes at scale and deploy AI products safely and confidently. Founded by machine learning experts from Meta AI and Meta Reality Labs, Patronus AI is on a mission to boost enterprise confidence in generative AI. We are backed by Lightspeed Venture Partners, Replit CEO Amjad Masad, Gokul Rajaram, and Fortune 500 executives and board members.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About Patronus AI

Patronus AI is a frontier lab developing simulation research and infrastructure to accelerate progress toward human-aligned AGI. We are on a mission to simulate all of the world’s intelligence.

We are the team behind some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher, Humanity’s Last Exam, and more. We are formerly AI researchers and engineers from companies like Meta AI, Amazon AGI, and Google. Our customers include foundation model labs and Fortune 500 enterprises like Adobe. We are backed by top-tier investors like Lightspeed Venture Partners, Notable Capital, Stanford University, Noam Brown, Gokul Rajaram, and more.

At a glance

  • Engagement: Independent contractor, fully remote
  • Pay: $50/hr - $150/hr
  • Start: Rolling
  • Location: Remote
  • Team: Expert Operations

The role

Our work is produced by practising domain experts on contract. You are the person a large group of them in several domains deals with every week: their point of contact for support, feedback, retention and performance.

Most companies doing this work treat an expert bench as a support queue. We do not. An expert who goes quiet three weeks in is a hire we paid for and never used, and the person best placed to see it coming is the one who talks to them. 

You are not a ticket queue and you are not a reviewer. Both of those exist here as separate roles, and part of your job is routing requests to the right person or system.

What you'll do

  • Be the consistent point of contact for the experts in your domains. They should know your name and expect a reply within hours.
  • Own onboarding through to first accepted submission. This is where most people who leave, leave, and getting someone past it is the highest-value thing you do.
  • Hold performance conversations at both ends of your group: the people whose work is slipping, and the people good enough to put forward for review work.
  • Know why someone is about to stop before they stop, and escalate this information to your project lead.
  • Route problems to the right place. Billing, payments and tooling go to expert support. Questions about the quality bar go to the quality team.
  • Tell your project lead the truth about capacity, including when the number on the plan is not going to happen.
  • Use AI aggressively. Anything repeatable in how you track, brief and follow up with a large group should be automated, so your hours go to the conversations.

Who we're looking for

Required

  • Experience with a contingent or freelance workforce, or moderating a technical community.
  • You can tell a capable professional their work is not clearing the bar and still be the person they come back to next week.
  • Fast, clear writing. Almost all of this job happens in text, across time zones.
  • Ability to gain enough fluency in the domain to tell a real blocker from an excuse. 
  • Organised without being asked. You will be tracking a lot of people and nobody will chase you for it.
  • Comfort working inside internal tooling that is still being built, and reporting the bugs rather than working around them.
  • Ability to work independently and asynchronously against deadlines.

Nice to have

  • Experience in one of our domains: game development, software engineering, professional work such a legal, healthcare, finance or sales or another specialist field we hire into.

How hiring works

  • Resume review and a conversation with Talent Operations
  • A practical exercise: a real situation from the bench, handled in writing
  • Interview with existing expert manager
  • Onboarding and your first domain

Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

By clicking ‘Apply’, you agree to both of the following:

1) Greenhouse's Terms of Service and Privacy Policy

2) Patronus AI, Inc. Privacy Policy.

Related jobs

See all jobs

Other jobs at Patronus AI