Role overview

Qualifications

3+ years of QA experience, with 2+ years in QA automation
Active hands-on usage of LLMs (GPT, Claude, Llama, etc.) in your QA workflows
Strong Python and PyTest skills
Hands-on experience with SQL (PostgreSQL, ClickHouse)

Responsibilities

Build AI-based testing frameworks and pipelines that automate the full QA workflow
Perform functional, regression, integration, and load testing across agent workflows
Analyze defects and incidents, identify root causes, and help prevent regressions
Collaborate closely with developers, product managers, and RD on release validation

Key facts

Remote from: Estonia
Full time
Mid-level (2-5 years)
QA Engineer
English

Hard skills

Test Automation AI Testing Python (Programming Language) PyMOL SQL (Programming Language) CI/CD Project Integration

Other skills

Collaboration
Problem Solving

About the company

Improvado

Madtech: Marketing + Advertising + Technology

Improvado automates marketing reporting, enables informed budget decisions, and increases the ROI of marketing efforts. We help marketing teams streamline inefficient spreadsheet analytics and achieve deep insights into revenue generation. Improvado connects data across 300+ marketing and sales platforms to build a holistic picture of marketing performance. As an end-to-end analytics platform, Improvado handles everything, from data extraction and normalization to visualizing data in insightful dashboards. With Improvado, it’s easy to track the performance of your cross-channel efforts, calculate complex metrics such as CLV or CAC, attribute revenue to touchpoints, and recreate customer journeys. Want to learn more? Schedule a demo at www.improvado.io.

Company details

Company typeScaleup

IndustryMadtech: Marketing + Advertising + Technology

Company size51 - 200

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

QA Engineer – AI-Assisted Testing

We're a fast-growing Series A startup backed by $34M in funding and driven by a team that moves fast, stays curious, and cares about high-quality execution.

We're looking for an AI-native QA Engineer with 3+ years of experience who will automate the workflow using modern AI frameworks and tools like Codex and Claude. You'll leverage LLMs to speed up testing, bug analysis, and test generation while maintaining rigor through architecture, documentation, and proper validation. You'll help us scale our AI Agent and platform with confidence—automating what matters, catching what counts, and using AI as a core part of how you work.

Responsibilities

Build AI-based testing frameworks and pipelines that automate the full QA workflow: design test strategies, develop automated tests, create and execute test plans, perform different types of testing across workflows, and analyze defects—all powered by LLM tools and modern AI frameworks
Perform functional, regression, integration, and load testing across agent workflows
Analyze defects and incidents, identify root causes, and help prevent regressions
Collaborate closely with developers, product managers, and R&D on release validation
Contribute to improving QA processes, test coverage, and automation practices

Requirements

3+ years of QA experience, with 2+ years in QA automation
Active hands-on usage of LLMs (GPT, Claude, Llama, etc.) in your QA workflows—not just interest, but real experience in building AI based QA pipelines
Strong Python and PyTest skills
Hands-on experience with SQL (PostgreSQL, ClickHouse)
Solid understanding of REST APIs, client-server architecture, and web services
Experience creating and maintaining automated test suites in CI/CD pipelines
Ability to work independently with complex business logic
Ability to work in EST timezone

Nice to Have

Experience testing data pipelines or integration workflows
Startup experience

What We Offer

Remote-first environment
20 PTO days + U.S. holidays
Modern AI tech stack and freedom to experiment
Extremely fun & open startup environment
Professional development reimbursement