Logo for NorthBay Solutions

Senior AI QA Engineer

Roles & Responsibilities

  • Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation (Selenium, Pytest)
  • API Testing (REST) and CI/CD Integration

Requirements:

  • Define test strategy and create test cases for AI/ML and data-driven applications; develop automated frameworks and end-to-end testing across the AI/ML lifecycle.
  • Perform API testing (REST) and validate data pipelines/ETL processes and ML model outputs; integrate automated tests into CI/CD pipelines.
  • Execute regression, integration, system, and performance testing; identify and track defects to closure; ensure QA standards and compliance.
  • Collaborate with Data Engineers, ML Engineers, and DevOps teams; mentor junior QA engineers.

Job description

Job Title: Senior AI QA Engineer
Experience Required: 4–6 Years
Employment Type: Full-Time
Work Mode: Remote
Location: India


Job Summary

We are seeking a Senior AI QA Engineer with 4–6+ years of experience in software quality assurance, test automation, and validation of data-driven and AI/ML systems. The role involves test planning, automation framework development, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines. The candidate will work closely with engineering, data, and DevOps teams to ensure high-quality, scalable AI solutions.


Key Responsibilities

  • Define and execute test planning, test strategy, and test cases for AI/ML and data-driven applications
  • Develop and maintain automated test frameworks using Selenium and Pytest
  • Perform API testing for RESTful services
  • Validate data pipelines, ETL workflows, and ML model outputs
  • Conduct end-to-end testing across AI/ML lifecycle including data ingestion, training, inference, and deployment
  • Integrate automated test suites into CI/CD pipelines
  • Perform regression, integration, system, and performance testing
  • Identify, document, and track defects to closure
  • Collaborate with Data Engineers, ML Engineers, and DevOps teams
  • Ensure adherence to QA standards, best practices, and compliance requirements
  • Mentor junior QA team members when required

Required Skills

  • Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation
  • Selenium
  • Pytest
  • Python
  • API Testing (REST)
  • CI/CD Integration
  • Data Pipeline Testing
  • AI/ML Pipeline Testing
  • Regression Testing
  • Defect Tracking
  • Git / Version Control

Preferred Skills

  • Machine Learning model validation (accuracy, drift, bias)
  • Cloud platforms (AWS, Azure, GCP)
  • Docker and Kubernetes
  • Performance and Load Testing
  • Data Quality and Monitoring frameworks

QA Engineer Related jobs

Other jobs at NorthBay Solutions

We help you get seen. Not ignored.

We help you get seen faster — by the right people.

🚀

Auto-Apply

We apply for you — automatically and instantly.

Save time, skip forms, and stay on top of every opportunity. Because you can't get seen if you're not in the race.

AI Match Feedback

Know your real match before you apply.

Get a detailed AI assessment of your profile against each job posting. Because getting seen starts with passing the filters.

Upgrade to Premium. Apply smarter and get noticed.

Upgrade to Premium

Join thousands of professionals who got noticed and hired faster.