Japanese-English Evaluator - AI Trainer

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Internet-Native Bilingual Evaluator Expert (Japanese)
Type: Contract
Compensation: $30–$40/hour
Location: Remote
Commitment: 10–20 hours/week

Role Responsibilities

• Analyze content from social media, forums, video platforms, gaming communities, and digital communication channels.
• Assess AI-generated outputs for linguistic quality, cultural relevance, and authenticity.
• Evaluate internet slang, memes, abbreviations, emoji usage, honorific language, and code-switching.
• Create evaluation rubrics for internet-native bilingual communication.
• Document linguistic and cultural edge cases specific to Japanese and English online communities.
• Test AI systems using bilingual prompts and real-world internet scenarios.

Qualifications

Must-Have

• Native or near-native fluency in Japanese and professional fluency in English.
• Deep familiarity with Japanese and English internet culture.
• Active engagement with platforms such as X, YouTube, Discord, Reddit, Twitch, Nico Nico, gaming communities, or similar online ecosystems.
• Strong writing, analytical, and critical thinking skills.
• Understanding of internet slang, memes, internet etiquette, and online communication norms in both languages.

Preferred

• Background in linguistics, translation, localisation, journalism, social media, humanities, or AI evaluation.
• Experience evaluating user-generated content or online communities.
• Familiarity with internet subcultures, fandoms, gaming communities, and contemporary digital trends.
• Interest in AI, language models, and multilingual communication research.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.