Logo for Vimo

Quality Analyst Engineer (AI)

Requirements:

  • Develop testing strategies for conversational AI (GenAI) experiences: context retention, policy accuracy, hallucination checks, and fallback behaviors.
  • Collaborate with AI/ML teams to define evaluation datasets (golden sets), define testing coverage, and monitor regression.
  • Create reusable test cases across multiple call flows and edge cases for eligibility interviews, application processing, and account updates.
  • Drive test data creation, synthetic scenario generation, and manage tooling across multiple environments (UAT, staging, prod).

Job description

About GetInsured 
 
What started as the “Expedia” of health insurance, has grown to a market leading company that is transforming government IT infrastructures with our proven SaaS and AI technology. Our innovative approach to health insurance shopping and enrollment has expanded beyond exchanges, and we’re now reinventing the way states administer safety net programs such as Medicaid, SNAP (food stamps), childcare, and unemployment insurance. With our cutting-edge technology, we’re helping agencies help more people, faster, and transform health care delivery as we know it. 

We are looking for a Quality Analyst Engineer for our AI products, including conversational call center applications.  

About The Role 

As a Quality Analyst Engineer, you’ll work in a supportive, fast-paced, and collaborative environment, and get hands-on experience with real-world data, scalable AI systems, and cutting-edge LLMs (Large Language Models). 

 

Responsibilities -  

  • Develop testing strategies for conversational AI (GenAI) experiences: context retention, policy accuracy, hallucination checks, and fallback behaviors. 

  • Collaborate with AI/ML teams to define evaluation datasets (golden sets), define testing coverage, and monitor regression. 

  • Create reusable test cases across multiple call flows and edge cases for eligibility interviews, application processing, and account updates. 

  • Drive test data creation, synthetic scenario generation, and manage tooling across multiple environments (UAT, staging, prod). 

  • Own defect lifecycle and work closely with Product, Engineering, and Business Process teams to prioritize and resolve issues. 

Quality Improvement Engineer Related jobs

Other jobs at Vimo

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.