Proficiency in English at B2+ level, mainly for reading and writing.
Attention to detail and strong time-management skills.
Proactive approach and curious mindset.
No specific educational background required, training provided.
Requirements:
Evaluate AI agent replies based on provided guidelines.
Identify differences between two responses to a request.
Assess and compare responses to determine which is better and assign ratings.
Job description
We are seeking a meticulous and detailoriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).
The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.
Full online training is provided.
The role is fully remote with the possibility of having a flexible schedule.
We are open to both fulltime and parttime candidates.
Requirements:
at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
attention to detail
timemanagement skills
proactive approach
curious mind
Responsibilities:
evaluate replies of the AI agent according to the provided guidelines
recognize and evaluate differences between two possible responses to a request
compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating
