Logo for Welo Global

Andromeda Shimu Deep Research Reviewer (EN-US)

Role overview

Summary

This role is for a QA Deep Research Reviewer at Andromeda Shimu, focused on evaluating AI-generated research outputs. You will assess the quality of long-form documents against established guidelines, contributing to the improvement of AI research tools.

Qualifications

  • Native or near-native US English (C2), with the ability to read long documents containing tables and citations.
  • Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning.
  • Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA.
  • Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA).
  • Ability to write concise rationales that cite evidence.

Responsibilities

  • Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Evaluate each response against rubric criteria, scoring every criterion independently
  • Check claims, tables, and citations for accuracy, distinguishing primary sources from low-quality pages
  • Write short, specific rationales that point to concrete evidence

Key facts

Hard skills

Key skills for this role

Other skills

  • Analytical Skills
  • Detail Oriented

About the company

Welo Global logo

Welo Global

  • Translation & Localization
  • 1,001–5,000
Welo Global is a leader in multilingual AI, technology, and content solutions serving over 2,000 clients in 300 languages. The company combines globally scaled multilingual infrastructure, including a network of over 500,000 linguists and domain experts, with advanced NLP, computational linguistics, and best-in-class compliance backed by seven ISO certifications. Welo Global’s five brands—Welocalize (multilingual content and localization solutions for localization and technology teams), Adapt (multilingual performance-led digital marketing agency), Park IP (patent translation, foreign filing, and legal solutions for law firms and corporate legal teams), Welo Life Sciences (multilingual content solutions for drug and medical device development for pharmaceutical, clinical contract research, and medical device organizations), and Welo Data (multilingual data generation, evaluation, and human data infrastructure for AI systems)—serve distinct customer segments with purpose-built expertise, fit-for-purpose solutions, and supporting technology. weloglobal.com

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the Role 

We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently

Project Details:

Location: Remote (United States)

Commitment: 15-20 hours per week

Engagement type: Freelancer

Pay rate: Philippines: $28 USD

What You'll Do

• Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning

• Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments

• Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages

• Write short, specific rationales (1-3 sentences) that point to concrete evidence

• Follow guideline updates and calibrate your decisions consistently with the QA team.

Must-Have Qualifications

• Native or near-native US English (C2), with the ability to read long documents containing tables and citations

• Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning

• Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA

• Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)

• Ability to write concise rationales that cite evidence

• Ability to judge each criterion independently, without letting an overall impression influence the call

• Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.


Salary: 28 USD per hour

Related jobs

See all jobs

Other jobs at Welo Global