Logo for 24-MAG

Remote | Russian Audio AI Evaluator — Up to $45/hour

Role overview

Qualifications

  • Native or near-native fluency in Russian, both spoken and written
  • Professional fluency in English
  • Strong familiarity with contemporary spoken Russian, regional vocabulary, dialects, and informal language
  • Prior experience with transcription, annotation, localisation, language evaluation, or research workflows is advantageous

Responsibilities

  • Listen to, analyse, and transcribe Russian-language audio and video content
  • Evaluate Russian-language content for linguistic accuracy, fluency, clarity, and naturalness
  • Develop clear evaluation criteria for high-quality Russian-language audio responses
  • Test language-model outputs across Russian audio tasks

Key facts

Other skills

  • Analytical Skills
  • Editing
  • Quality Assurance
  • Detail Oriented
  • Critical Thinking

About the company

24-MAG logo

24-MAG

Business Consulting & Services

Company details

IndustryBusiness Consulting & Services
Company size2 - 10

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

We are sharing a specialised part-time consulting opportunity for Russian-language professionals with strong transcription, editing, analytical, and critical-listening skills to support advanced audio AI research.

This role focuses on transcription, annotation, and evaluation of Russian-language audio and video content for AI training and benchmarking. Selected professionals will assess linguistic accuracy, develop evaluation standards, review model-generated outputs, and help improve the quality of Russian audio AI systems.

Key Responsibilities

Russian Audio Transcription & Annotation

  • Listen to, analyse, and transcribe Russian-language audio and video content
  • Produce accurate written outputs in Russian, with supporting work in English when required
  • Follow detailed transcription, formatting, and annotation guidelines
  • Capture tone, intent, register, regional expressions, dialectal variation, and contemporary language usage
  • Maintain high accuracy and consistency across structured audio datasets

Language & Audio Evaluation

  • Evaluate Russian-language content for linguistic accuracy, fluency, clarity, and naturalness
  • Identify grammatical issues, colloquialisms, regional variations, and linguistic edge cases
  • Assess spoken Russian across general consumer audio contexts
  • Distinguish between formal and informal registers and evaluate context-appropriate language use
  • Provide structured feedback on language and transcription quality

Evaluation Standards & Rubric Development

  • Develop clear evaluation criteria for high-quality Russian-language audio responses
  • Create and refine grading rubrics in Russian and English
  • Document evaluation standards to support consistency across reviewers
  • Identify challenging linguistic cases requiring additional guidance
  • Contribute to the refinement of annotation and evaluation frameworks

AI Model Testing & Quality Assurance

  • Test language-model outputs across Russian audio tasks
  • Evaluate responses for accuracy, completeness, fluency, and instruction adherence
  • Grade model-generated outputs against defined evaluation criteria
  • Participate in quality-assurance and review cycles
  • Identify recurring model errors and provide feedback to improve performance
  • Collaborate with project teams to resolve ambiguities and improve task design

Ideal Profile

  • Native or near-native fluency in Russian, both spoken and written
  • Professional fluency in English
  • Strong familiarity with contemporary spoken Russian, regional vocabulary, dialects, and informal language
  • Ability to accurately transcribe and analyse Russian-language audio
  • Strong writing, editing, analytical, and critical-thinking skills
  • Excellent attention to linguistic detail and ability to follow detailed guidelines
  • Prior experience with transcription, annotation, localisation, language evaluation, or research workflows is advantageous
  • Background in linguistics, humanities, social sciences, journalism, translation/localisation, or a technical discipline is welcomed
  • Familiarity with AI, language models, or applied research environments is advantageous
  • Must be based in the San Francisco Bay Area
  • Available approximately 10–20 hours per week

Engagement Details

  • Part-time independent contractor engagement
  • Short-term, structured project
  • Fully remote, with occasional in-person collaboration in the San Francisco Bay Area if required
  • Compensation: Up to $45/hour
  • Approximately 10–20 hours per week
  • Flexible scheduling based on project requirements
  • Projects may be extended, shortened, or concluded based on project needs and performance
  • Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
  • H1-B and STEM OPT support is unavailable for this engagement

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
·

Related jobs

Other jobs at 24-MAG

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.