Offer summary

Qualifications:

Native English speaker from Canada, Minimum of 2 years of experience in language evaluation or related fields, Proficient in assessing accent and fluency in audio responses, Access to a personal laptop or PC for remote work.

Key responsabilities:

Create audio prompts and provide feedback on the model's audio responses

Evaluate the model's output focusing on accent and fluency

Iterate and generate audio responses until achieving at least two perfect ratings

Identify the best audio responses based on naturalness and fluency scores.

Summa Linguae Technologies is a language and technology service provider headquartered in Poland with 7 offices located across North America, Europe, and Asia.  We specialize in technology-enabled localization, managed services, and data solutions.    Intent on transforming the traditional approach to language, Summa Linguae is one of the industry's fastest-growing companies. We take an outcome-based approach, tailoring solutions to our customers' specific needs. Our promise is to help global, content-rich companies with every multilingual data challenge.    To learn more about Summa Linguae Technologies, our journey, and the solutions we offer, visit: https://summalinguae.com/. 

Job description

Role: English (Canada) Language Expert

Language Proficiency: Native speakers

Experience: 2+ years / 5 years of experience in language

Duration: 20-80 hours / 2-3 weeks (may extend depending on the project)

Scope of Work: The Audio Prompt Response Evaluation for Accent and Fluency aims to help an LLM application improve the fluency, accent, and dialect of its model audio responses.

Location: Remote

Employment: Freelance contract

Payment Terms: 30 - 45 days from the receipt of the invoice

Project Brief:

The goal is to assess the model's audio responses for a specific language/accent combination and help it learn, improve, and fine-tune its accent and fluency in the target language. Participants are expected to give audio prompts, generate audio responses, rate them on certain parameters including accent and fluency, and continue iterating/generating audio responses until at least two perfect responses are achieved.

Roles and Responsibilities:

Interact with the model in a designated language/accent by creating audio prompts and providing feedback on the model’s audio responses.
Evaluate and improve the model’s output from the perspective of accent and fluency. The content of the prompt or the response is not important.
Continue evaluating and iterating until you find at least two and a maximum of five responses with a perfect rating of 7 on accent. This may require generating numerous responses (10, 20, 30, etc.).
Identify between two and five audio responses that sound the best, with a score of 7 being the highest possible rating for how natural and fluent the model's speech is from the target language/locale’s accent perspective.

Skills Required: