Offer summary

Qualifications:

Bachelor's degree or equivalent in linguistics, philosophy, psychology, or communications., Experience in content moderation, data labeling, or quality assessment., Strong attention to detail and analytical skills., Excellent communication skills for providing nuanced feedback..

Key responsibilities:

Label and evaluate conversations to assess character traits.

Provide qualitative analysis of AI model behaviors and interactions.

Create and curate datasets for training and evaluation.

Identify trends and report areas for improvement.

****JOB SCAM ALERT**** We have been noticing a steady rise in job scams, where scammers are impersonating legitimate companies to defraud unsuspecting job seekers. To ensure your job search is safe, follow these quick safety tips and avoid potential scams: 1. Verify the Company's Legitimacy • Research the Employer: Look up the company online and verify their contact information on the official website. • Cross Check Email Domains: Legitimate companies use official email domains. Be wary of offers from generic email services or variations of the company’s actual domain (e.g., at LeadStack our actual email domain is leadstackinc.com; any variations like @leadstack-inc.com is a scam ). 2. Be Wary of Any Solicitation of Payments • Financial Details: Do not share bank details etc during the initial stages of the hiring process. • Upfront Payments: A legitimate employer will never ask you to pay for training, background checks, or any other job-related fees. 3. Report Suspicious Activity • Report Scams: Report any suspicious job offers to law enforcement, job boards, the impersonated company, and consumer protection agencies. Stay vigilant and informed. For more information, visit our website or contact us at info@leadstackinc.com ********* We are one of the nation’s fastest-growing, award- winning, certified minority-owned staffing services provider of contingent workforce. Our recognitions include: - "Best Staffing Firms to Work For" 2023, 2024 by Staffing Industry Analysts - Certified Great Place to Work - "Fastest Growing Staffing Firms" 2022, 2023 by Staffing Industry Analysts - "Diversity Owned Staffing Firm" 2022, 2023 by Staffing Industry Analysts - Minority Business Enterprise by NMSDC - Inc. 5000 honoree As a recognized industry leader in contingent workforce solutions, we’re proud to partner with some of the most admired Fortune 500 brands in the world. Visit us at www.leadstackinc.com

Job description

Rate: $75/hour

AI Data Trainer (6-Month Contract)
Location: Remote

About the Role: We are seeking AI Data Trainers to help develop and evaluate high-quality training data for our AI assistant's character development. As part of the Human Data Operations team, you will analyze conversations, provide detailed feedback, and help ensure our AI assistant demonstrates key traits like helpfulness, honesty, and harmlessness.

Key Responsibilities:

Label and evaluate conversations to identify examples of desired character traits and behaviors

Provide qualitative analysis of model behaviors and interaction patterns

Create and curate datasets for character training and evaluation

Identify and report novel trends, unexpected behaviors, or areas for improvement

Assist in developing benchmarks and evaluation criteria for AI character traits

Contribute to guidelines and documentation for character evaluation

Participate in regular calibration sessions with the team

Quality Standards:

Maintain high levels of precision and consistency in data labeling

Follow annotation guidelines and quality control processes

Participate in regular quality audits and calibration exercises

Document clear rationales for evaluation decisions

Flag edge cases and provide detailed feedback on challenging examples

Required Qualifications:

Bachelor's degree or equivalent experience in relevant field (e.g., linguistics, philosophy, psychology, communications)

Experience with content moderation, data labeling, or quality assessment

Strong attention to detail, analytical and critical thinking skills

Excellent written and verbal communication abilities

Ability to provide nuanced feedback on conversation quality and character traits

Comfortable working independently while maintaining consistent output quality

Required profile