Data Science Quality Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Strong background in quality assurance and data science., Experience with CICD GitHub Actions and API testing., Proficiency in Docker and AWS cloud deployment., Expertise in ML Ops and software engineering..

Key responsibilities:

  • Develop and implement quality assurance processes for data science projects.
  • Collaborate with data scientists and software engineers to ensure AI model accuracy.
  • Conduct API testing and manage CICD pipelines using GitHub Actions.
  • Provide insights for improving the quality of AI models and software applications.

CME logo
CME SME https://www.gotocme.com/
201 - 500 Employees
See all jobs

Job description

This is a remote position.

We are seeking a highly skilled and motivated Data Science Quality Engineer to join our team for the OPEN Q & QUBED software applications. The ideal candidate will have a strong background in quality assurance, data science, and software engineering, with a focus on generative AI and machine learning operations.

Responsibilities:

  • Develop and implement quality assurance processes for data science projects.
  • Collaborate with data scientists and software engineers to ensure the accuracy and reliability of AI models.
  • Conduct API testing, including NFT calls to OpenAI.
  • Manage CICD pipelines using GitHub Actions, with a focus on staging and development environments.
  • Perform Docker containerization and AWS cloud deployment.
  • Apply statistical and mathematical techniques to test machine learning models.
  • Provide insights and recommendations for improving the quality of AI models and software applications.


Requirements
  1. Knowledge of Generative AI.
  2. Experience with CICD GitHub Actions, with a focus on staging and development environments and quarterly production releases.
  3. Strong API testing skills, including NFT calls to OpenAI.
  4. Proficiency in Docker.
  5. Experience with AWS.
  6. Expertise in ML Ops, including statistical and mathematical testing of machine learning models.
  7. Background in software engineering.

Optional Skills:

  • Experience with guardrails from a QA perspective, particularly in dealing with LLM GI.

Tech Stack:

 

  1. Python, FastAPI, OpenAI/AWS Bedrock, Pytest
  2. Next.js, React, Typescript (Front end subject to change).


Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Quality Assurance

Data Quality Analyst Related jobs