AI Test Engineer

This is a remote position.

Job Description: AI Test Engineer

Experience: 3-5 yrs 

Location: Remote

Notice Period: Immediate joiner or max 15days preferred

We are looking for an experienced AI Tester with 3-5 years of expertise in software testing and AI/ML testing. The ideal candidate will validate AI systems' performance, accuracy, and compliance with ethical standards while ensuring high-quality deliverables.

Responsibilities:

• Develop and execute test plans for AI/ML models, ensuring functionality, performance, and reliability.

• Validate data integrity, model outputs, and preprocessing pipelines.

• Perform functional, regression, and performance testing for AI models, focusing on bias, fairness, and scalability.

• Test AI integrations in end-to-end systems and workflows.

• Build and maintain automation frameworks for AI testing using tools like TensorFlow Testing Library and PyTest.

• Analyze key metrics such as accuracy, latency, and resource utilization.

• Collaborate with cross-functional teams to enhance model quality and deployment processes.

• Document test cases, scenarios, and results, reporting issues using tools like Jira.

Skills Required:

• Proficiency in Python, AI/ML frameworks (e.g., TensorFlow, PyTorch), and testing tools.

• Solid understanding of software testing principles and AI/ML algorithms.

• Experience with model evaluation metrics (e.g., F1 Score, ROC-AUC) and cloud platforms (AWS, Azure, GCP).

• Strong communication, analytical, and problem-solving skills.

• Preferred: Experience with MLOps, ethical AI testing, and tools like SHAP or LIME.

● Decide technology & tool choices for your team & be responsible for them.