Senior QA Automation Engineer - Greenfield Quality Architecture

At Nonstop Health, we are engineering the backbone of modern healthcare benefits administration - handling high-stakes financial replenishment, automated member card substantiation, and cutting-edge enterprise AI platforms. We are looking for a Senior QA Automation Engineer to lead a massive 0-to-1 technical initiative: designing and building our global quality control plane from the ground up.

This is not a role maintaining somebody else's test suite. You will have full technical autonomy to architect an enterprise-grade automation infrastructure, establishing automated quality gates across an estate of high-scale cloud services, complex data pipelines, and AI agent workloads.

The Engineering Challenge

• Build 0-to-1 Quality Infrastructure: Establish the foundational test automation strategy across our entire platform, transforming complex distributed environments into highly deterministic, automated pipelines.
• Tame High-Stakes Asynchronous Workflows: Healthcare benefits and financial payouts leave zero room for error. You will build test strategies that catch edge cases across multi-writer databases, background sync schedulers, and asynchronous payment loops before they reach production.
• Pioneer AI & Agentic Testing: Work at the bleeding edge of software quality by developing evaluation methods for multi-agent LLM architectures, isolated MicroVM execution substrates, and Model Context Protocol (MCP) tool integrations.
• Embed Continuous Verification: Partner directly with platform leads to seamlessly integrate end-to-end integration, API, and regression test suites into modern CI/CD delivery pipelines.

60 Days: Fast Ramp & Immediate Quick Wins

• Execute Estate Audit: Map critical manual workflows, zero-coverage endpoints, and high-risk silent failure points across primary customer portals and core payment/substantiation pipelines.
• Establish Core Framework: Spin up the initial Playwright (TypeScript) and PyTest (Python) test automation harness with standardized configuration and HIPAA-compliant test data handling.
• Deliver First Automated Gate: Ship automated smoke tests for the primary web portals (Member, Client, Channel) to immediately catch deployment regressions before release.
• Automate Pipeline Gating: Embed automated smoke and sanity regression suites directly into Bitbucket Pipelines, eliminating manual verification overhead for web deploys.
• Guard High-Risk Pathways: Build synthetic probes and automated checks targeting key backend APIs (REST/SOAP) and asynchronous state transitions to detect silent process failures automatically.
• Expand API Integration Testing: Automate verification for key transaction flows, verifying state updates across shared MongoDB collections and external counterparty boundaries.

90 Days: End-to-End Regression & AI Integration

• Full Core Coverage: Achieve comprehensive automated regression coverage across all core web applications, backend services, and batch jobs.
• AI & Agentic Quality Gates: Implement automated evaluation suites for Nonstop OS AI agent flows, validating tool call accuracy, MicroVM runtime state integrity, and audit log PHI/PII redaction.
• Contract & Resiliency Tests: Deploy automated contract checks against external counterparty web interfaces and APIs to catch upstream UI or data format changes before they break production flows.

6 Months: Total Automation & Scaled Autonomy

• Zero-Manual Deployments: Transition quality verification entirely to automated CI/CD gating, cutting deployment risk and manual testing effort to near zero.
• State Machine & Edge Case Verification: Establish robust testing for complex financial payout state machines, background schedulers, and recovery/resubmission logic.
• Quality Ownership: Serve as the technical quality lead- -establishing continuous testing patterns, maintaining test data isolation, and training engineering leads on writing maintainable integration tests.

• Architectural Mindset: You have a proven track record of designing, scaling, and owning test automation frameworks from scratch, preferring clean, maintainable architecture over brittle record-and-playback solutions.
• Distributed Systems Intuition: You think deeply about failure modes in distributed environments- -understanding how state changes propagate across microservices, event queues, and third-party APIs.
• Technical Mastery: Strong hands-on engineering capabilities in TypeScript or Python, with deep experience utilizing modern testing engines (Playwright, PyTest) and containerized workflows.
• Data-Driven Rigor: Comfortable tracing and validating complex data flows across NoSQL databases (MongoDB), relational databases, and multi-account AWS environments (Lambda, Fargate, EventBridge).
• Bias for Impact: You thrive when given broad ownership over complex technical problems and take pride in turning unmonitored edge cases into rock-solid automated safety nets.

Compensation

The base salary range for this role is $110,000 - $160,000 depending on experience.

Great benefits aren't just for our clients! We cover 100% of medical, dental and vision benefits for employees and dependents. We also contribute to your retirement goals, with a 401k match up to 4%.

Must be authorized to work for any employer in the United States. This job does not offer visa sponsorship.

Who We Are

Our main offering is a MERP that, when paired with a HDHP, offers first dollar coverage to employees at a lower premium cost. This means people have access to early care without the worry of a copay, coinsurance, or deductible. Ultimately, early care drives down overall cost and improves health and happiness. We think this is the way healthcare should work! Our primary sales channel is selling into brokers. We have a national presence with a growing book of business and expanded product offerings.

Our team at Nonstop is where our magic really comes to life. We are driven, curious, collaborative, passionate, mission oriented, and most of all - we are real people who love what we do and believe in the real impact we are driving for people all over the US.