Logo for Netomi

Director, Quality Engineering & AI Testing

Role overview

Qualifications

  • 12+ years of experience in Software Quality Assurance, Quality Engineering, or Testing
  • 5+ years of leadership experience managing global QA organizations
  • Experience leading quality functions within enterprise SaaS companies
  • Strong background in test automation, CI/CD, and modern engineering practices

Responsibilities

  • Define and execute the company-wide quality engineering strategy
  • Build and scale a high-performing global QA and Quality Engineering organization
  • Establish quality standards, governance, metrics, and release readiness frameworks
  • Drive a quality-first culture across Product, Engineering, and Delivery teams

About the company

Netomi logo

Netomi

Artificial Intelligence & Machine Learning Services

Netomi helps companies deliver higher quality customer experiences at scale with AI. If customer service is not a priority, you don't have to read any further. Warner Bros, Westjet, and HP trust Netomi's AI-first customer service platform to deliver eye-popping results. Doing this all while significantly reducing cost. Netomi is building the first Relationship Operating System and its three main benefits for companies are: - Industry-leading resolution rates (automatically resolves 80% of routine customer service inquiries) - Improved resolution time - Increased customer satisfaction and support quality People love our patented, no-code platform, which works across messaging, chat, email and voice. The platform also understands 100+ languages - Β‘QuΓ© bueno! Netomi is based in San Francisco and has offices in Toronto, New York, and India. Want to work from your home office? We have remote options as well! We can't hire fast enough, join this incredible team today!

Company details

Company typeScaleup
IndustryArtificial Intelligence & Machine Learning Services
Company size51 - 200

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the Company:
Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world’s largest global brands do business? Join us!

We are seeking a highly experienced Director of Quality Engineering & AI Testing to lead our global quality organization and establish world-class testing practices for enterprise SaaS and AI-driven products.

This leader will be responsible for building quality strategy, scaling test automation, improving release confidence, and driving reliability across platform, AI, and customer-facing solutions. The ideal candidate combines deep expertise in software quality engineering with modern approaches to AI testing, automation, and continuous delivery.

This role will partner closely with Engineering, Product Management, Applied AI, Customer Success, and Delivery teams to ensure Netomi delivers highly reliable, scalable, and secure enterprise-grade solutions.


Responsibilities:

Quality Strategy & Leadership:

  • Define and execute the company-wide quality engineering strategy.

  • Build and scale a high-performing global QA and Quality Engineering organization.

  • Establish quality standards, governance, metrics, and release readiness frameworks.

  • Drive a quality-first culture across Product, Engineering, and Delivery teams.

  • Test Automation & Engineering Excellence:

    • Lead the design and implementation of scalable automated testing frameworks.

    • Increase automation coverage across UI, API, integration, regression, and performance testing.

    • Define best practices for CI/CD quality gates and release validation.

    • Partner with Engineering to embed quality throughout the software development lifecycle.

    • AI & Agentic Testing:

      • Develop testing frameworks for AI-powered agents, workflows, prompts, and LLM-driven experiences.

      • Establish methodologies for evaluating accuracy, hallucinations, guardrails, safety, and reliability.

      • Drive automated evaluation strategies for AI agent behavior and customer outcomes.

      • Collaborate with Applied AI teams on model validation and production monitoring.

      • Enterprise Platform Quality:

        • Ensure quality across APIs, integrations, workflows, web applications, and enterprise deployments.

        • Lead performance, scalability, reliability, and security testing initiatives.

        • Improve defect prevention and root-cause analysis processes.

        • Establish production quality monitoring and feedback loops.

        • Metrics & Continuous Improvement:

          • Define KPIs around release quality, defect leakage, automation coverage, customer-impacting incidents, and platform reliability.

          • Analyze trends and implement continuous improvement initiatives.

          • Drive operational excellence through data-driven decision-making.

          • Team Leadership:

            • Recruit, mentor, and develop QA managers, automation engineers, and quality engineers.

            • Build career frameworks and competency models for the quality organization.

            • Foster a culture of ownership, innovation, and continuous learning.


Required Experience:
  • 12+ years of experience in Software Quality Assurance, Quality Engineering, or Testing.
  • 5+ years of leadership experience managing global QA organizations.
  • Experience leading quality functions within enterprise SaaS companies.
  • Strong background in test automation, CI/CD, and modern engineering practices.
  • Experience testing distributed systems, APIs, cloud-native applications, and enterprise integrations.
  • Proven track record of scaling quality organizations in high-growth environments.

Preferred Experience:
  • Experience with AI, Generative AI, Conversational AI, Agentic AI, or Machine Learning products.
  • Experience designing testing strategies for LLM-based applications.
  • Familiarity with prompt evaluation, model validation, and AI quality metrics.
  • Experience working with enterprise customers and large-scale deployments.
  •  


    Technical Expertise:
  • Test Automation Frameworks
  • API Testing
  • Performance & Load Testing
  • CI/CD Pipelines
  • Cloud Platforms (AWS preferred)
  • Microservices Architecture
  • AI/LLM Testing Methodologies
  • Security & Reliability Testing
  •  


    Success Metrics:

    Within the first 12 months, this leader will:

    • Significantly improve automation coverage across the platform.
    • Reduce escaped defects and production incidents.
    • Establish a scalable AI testing and evaluation framework.
    • Improve release velocity while maintaining high quality standards.
    • Build a world-class Quality Engineering organization aligned with Netomi's growth objectives.
    Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

    Apply once. Then go straight to the hiring manager.

    After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

    MR

    Marcus Rivera

    Chief Revenue Officer

    m.rivera@company.com
    linkedin.com/in/marcusrivera
    Unlocked after you apply
    Β·

    Director of Global QA (Quality) Related jobs

    Other jobs at Netomi

    Premium

    Reach out to the hiring manager directly.

    Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

    • Full match report with fit score and gaps
    • Career diagnostics on how recruiters read you
    • Curated company matches and warm intros
    • 48h early access to new roles

    Cancel anytime.