Logo for Workiy Inc.

QA Lead – Agentic AI Platform

Workiy Inc.

Role overview

Qualifications

  • QA Leadership
  • Python Test Automation
  • AI/LLM Testing
  • Conversational AI Testing

Responsibilities

  • Define quality standards
  • Develop automated evaluation frameworks
  • Lead test strategy
  • Ensure release readiness for AI-powered solutions

About the company

Workiy Inc. logo

Workiy Inc.

IT Services & IT Consulting

Workiy provides digital solutions and staffing services, utilizing our patented delivery model and a unique and flexible, client-centric approach to tackling technology's biggest challenges. We don’t have “clients” we have partners! Our mission is to enable your talented teams and amazing systems to assist your business in optimally achieving its goals. The Workiy team, brings to the table, more than 20+ years of experience in the technology industry across many verticals in both the private and public sector.

Company details

Company typeSME
IndustryIT Services & IT Consulting
Company size11 - 50

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

This is a remote position.

Job Description:


We are seeking an experienced QA Lead to drive end-to-end quality assurance for an advanced Agentic AI platform. This role will be responsible for defining quality standards, developing automated evaluation frameworks, leading test strategy, and ensuring release readiness for AI-powered conversational solutions. The ideal candidate will have strong expertise in Python-based test automation, AI/LLM testing, conversational AI validation, and Retrieval-Augmented Generation (RAG) systems. Responsibilities include building evaluation harnesses, creating test plans, executing regression testing, validating data quality, conducting AI safety and prompt injection testing, managing defect triage, and leading a team of QA and Data Testers. The QA Lead will collaborate closely with engineering, product, architecture, and data teams to ensure reliable, scalable, and high-quality AI solutions are delivered while maintaining robust quality gates and release standards.

Requirements

  • QA Leadership
  • Python Test Automation
  • AI/LLM Testing
  • Conversational AI Testing
  • RAG (Retrieval-Augmented Generation) Testing
  • LLM Evaluation Frameworks
  • Golden Dataset & Regression Testing
  • Intent & Context Validation
  • Multi-Turn Dialogue Testing
  • Data Quality Testing
  • Prompt Injection & AI Safety Testing
  • Release Readiness & Quality Gates
  • Defect Management & Test Strategy
  • CI/CD Integrated Testing
  • Team Leadership & Mentoring

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Worldwide

Other jobs at Workiy Inc.

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.