Testing Manager - Remote (WFH)

About Cognitive:

Cognitive is an IT and software engineering services company dedicated to elevating the quality, speed and delivery of today’s US government healthcare programs. With a wealth of clinical expertise and hands-on experience, our team understands the significant challenges our government clients—and their customers—face every day. This real-world experience equips us to develop IT solutions that seamlessly connect all facets of healthcare delivery. At Cognitive, we’re guiding government agencies to the forefront of technology innovation in healthcare delivery.

Position Overview:

*This position is contingent upon contract award*

The Testing Manager is responsible for automated testing, performance testing, and security testing across the CMS Drug Data Processing System (DDPS) and Payment Reconciliation System (PRS). This individual owns the end-to-end quality assurance strategy, including the 80 percent automated unit test coverage mandate, Behavior-Driven Development (BDD) and Test-Driven Development (TDD) practices, QASP metric definition and self-assessment, and test tooling operations within the CMS enterprise test environment.

This is a remote position; however, Cognitive hires only in the following designated U.S. states based on contract and business requirements: VA, DC, MD, TN, FL, AZ, CO, OR, and TX.

Key Responsibilities:

• Own automated, performance, and security testing across the DDPS/PRS estate; maintain 80 percent or greater automated unit test coverage using Python Pytest/UnitTest and DBFit/FitNesse frameworks; support BDD and TDD practices across all sprint teams.
• Perform regression and post-implementation validation testing following each CMS release; integrate automated test execution into the CI/CD pipeline via Jenkins/CloudBees, JFrog Artifactory, SonarQube, and Snyk.
• Operate within CMS enterprise test tooling including TestRail for test case management, JIRA for defect tracking, and GitHub for source-controlled test artifacts.
• Propose and maintain QASP performance standards, metrics, measurement methods, reporting frequencies, and corrective action thresholds for both technical/system and operational/process metrics; submit quarterly QASP self-assessments no later than 2 weeks after PI end.
• Track and surface real-time operational quality metrics like PDE processing volumes, error rates, reconciliation accuracy, and system uptime using CloudWatch, Splunk, and New Relic.
• Support security testing coordination with Nessus, CrowdStrike, AWS Inspector, SecurityHub, and GuardDuty; comply with CMS AI governance policies when testing AI/ML models including bias detection and human-in-the-loop review.
• Operate within the CMS Lean-Agile Release Train adhering to the MEPS Iteration Schedule; contribute to PI Planning and submit Release Deliverables per the MEPS Agile Handbook.

Qualifications:

Why Join Us?