Senior QA Automation Engineer (LLM & Video analysis) (Mexico - 100% Remote)

Job description

About AllShore Talent:
AllShore Talent is a leading remote staffing company, offering top-tier professionals working 100% remote to businesses worldwide. Specializing in IT and software development, design, administrative support, digital marketing, and more. AllShore connects organizations with skilled talent to meet diverse business needs.

About The Client:

Our client is the world's leading media-focused consultancy. Spanning the globe with 20 locations, they are connected with customers in every time zone. They strategize, advise, design and implement technology and business solutions tailored to businesses needs. They provide technology and business services through offices in New York, Los Angeles, Austin and Mexico.

They have now been engaged to produce a web-based business application for their client, which is about to go live. They need an engineer to quickly join the team to help with the launch and then maintain and enhance the application over the next 12 months.

Project Details:

The project evolves designing and implementing an automated testing focused on validating outputs of large language models and video analysis systems, ensuring accuracy, performance, and scalability.

Profile Description:

We are seeking an experienced Senior QA Automation Engineer to design, develop, and execute testing frameworks focused on the integration of large language models (LLMs) and computer vision systems for video analysis applications. The ideal candidate will ensure the accuracy and reliability of model outputs, focusing on both LLMs and video content interpretation.

Job requirements

Responsibilities:

• Design and implement automated testing frameworks for LLM-based systems integrated with video analysis.
• Develop and execute test plans, test cases, and test scripts for models related to vision and language understanding.
• Validate the outputs of LLMs and video analysis systems, ensuring consistency, accuracy, and performance.
• Conduct performance and scalability testing, ensuring models and systems can handle large-scale datasets.
• Work closely with data scientists and developers to identify potential edge cases, bugs, and system flaws.
• Create and maintain detailed documentation of testing procedures, frameworks, and outcomes.
• Implement continuous integration/continuous deployment (CI/CD) testing pipelines.
• Stay up-to-date with emerging trends and best practices in QA automation, LLMs, and computer vision.

Requirements:

• 5+ years of experience in QA automation, with at least 2 years testing LLMs.
• Strong experience in testing frameworks (e.g., Selenium, JUnit, PyTest) and automation tools.
• Familiarity with large language models (LLMs) and experience testing their outputs for accuracy.
• Experience in Python programming language for developing test scripts.
• Knowledge of video analysis or computer vision systems (e.g., OpenCV, TensorFlow).
• Experience with CI/CD pipelines and tools (e.g., Jenkins, GitLab CI).
• Strong problem-solving skills and attention to detail in identifying system flaws and bugs.

Excellent communication and documentation skills.