Role overview

Qualifications

5+ years of overall experience in QA/SDET roles
Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
Strong understanding of testing AI/ML products and their unique challenges
Hands-on knowledge of RAG pipelines and their testing methodologies

Responsibilities

Design, develop, and maintain automation frameworks and test strategies for AI products
Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)
Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance
Leverage AI automation tools to optimize test coverage and efficiency

Key facts

Remote from: India
Full time
Senior (5-10 years)
Software Development Engineer in Test (SDET)
English

Hard skills

Computational Tools AI Testing API Testing CI/CD Mload Continuous Training

Other skills

Problem Solving
Mentorship
Leadership
Communication
Teamwork

About the company

HighLevel

Information Technology & Services

One white-labeled marketing app to rule them all. HighLevel is everything your agency needs to succeed!Capture leads using our landing pages, surveys, forms, calendars, inbound phone system & more!Automatically message leads via voicemail, forced calls, SMS, emails, FB Messenger & more!Use our built in tools to collect payments, schedule appointments, and track analytics!

Company details

Company typeScaleup

IndustryInformation Technology & Services

Company size201 - 500

Links

Website LinkedIn See all jobs

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About HighLevel:
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.

Our PeopleWith over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.

Our ImpactEvery month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.Learn more about us on our YouTube Channel or Blog Posts

About the Role:

We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands-on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.

Requirements:

5+ years of overall experience in QA/SDET roles

Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)

Strong understanding of testing AI/ML products and their unique challenges

Hands-on knowledge of RAG pipelines and their testing methodologies

Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)

Experience with API testing (Postman, REST, GraphQL, gRPC)

Strong problem-solving skills with the ability to work independently

Mentorship and leadership skills in guiding peers or junior engineers

Responsibilities:

Design, develop, and maintain automation frameworks and test strategies for AI products

Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)

Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance

Leverage AI automation tools to optimize test coverage and efficiency

Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases

Own tasks end-to-end, working independently to deliver on commitments.

Mentor and guide junior SDETs, fostering a culture of quality and continuous learning

Nice to have

Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)

Familiarity with MLOps pipelines and monitoring AI systems

Exposure to performance and scalability testing of AI workloads

EEO Statement:

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.

We encourage you to review our Privacy Policy before submitting your application.

#LI-Remote #LI-JM1

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.