Bachelor's degree or equivalent in linguistics, philosophy, psychology, or communications., Experience in content moderation, data labeling, or quality assessment., Strong attention to detail and analytical skills., Excellent communication skills for providing nuanced feedback..
Key responsibilities:
Label and evaluate conversations to assess character traits.
Provide qualitative analysis of AI model behaviors and interactions.
Create and curate datasets for training and evaluation.
Identify trends and report areas for improvement.
Report this Job
Help us maintain the quality of our job listings. If you find any issues
with this job post, please let us know. Select the reason you're reporting
this job:
****JOB SCAM ALERT****
We have been noticing a steady rise in job scams, where scammers are impersonating legitimate companies to defraud unsuspecting job seekers. To ensure your job search is safe, follow these quick safety tips and avoid potential scams:
1. Verify the Company's Legitimacy
• Research the Employer: Look up the company online and verify their contact information on the official website.
• Cross Check Email Domains: Legitimate companies use official email domains. Be wary of offers from generic email services or variations of the company’s actual domain (e.g., at LeadStack our actual email domain is leadstackinc.com; any variations like @leadstack-inc.com is a scam ).
2. Be Wary of Any Solicitation of Payments
• Financial Details: Do not share bank details etc during the initial stages of the hiring process.
• Upfront Payments: A legitimate employer will never ask you to pay for training, background checks, or any other job-related fees.
3. Report Suspicious Activity
• Report Scams: Report any suspicious job offers to law enforcement, job boards, the impersonated company, and consumer protection agencies.
Stay vigilant and informed. For more information, visit our website or contact us at info@leadstackinc.com
*********
We are one of the nation’s fastest-growing, award- winning, certified minority-owned staffing services provider of contingent workforce.
Our recognitions include:
- "Best Staffing Firms to Work For" 2023, 2024 by Staffing Industry Analysts
- Certified Great Place to Work
- "Fastest Growing Staffing Firms" 2022, 2023 by Staffing Industry Analysts
- "Diversity Owned Staffing Firm" 2022, 2023 by Staffing Industry Analysts
- Minority Business Enterprise by NMSDC
- Inc. 5000 honoree
As a recognized industry leader in contingent workforce solutions, we’re proud to partner with some of the most admired Fortune 500 brands in the world.
Visit us at www.leadstackinc.com
AI Data Trainer (6-Month Contract) Location: Remote
About the Role: We are seeking AI Data Trainers to help develop and evaluate high-quality training data for our AI assistant's character development. As part of the Human Data Operations team, you will analyze conversations, provide detailed feedback, and help ensure our AI assistant demonstrates key traits like helpfulness, honesty, and harmlessness.
Key Responsibilities:
Label and evaluate conversations to identify examples of desired character traits and behaviors
Provide qualitative analysis of model behaviors and interaction patterns
Create and curate datasets for character training and evaluation
Identify and report novel trends, unexpected behaviors, or areas for improvement
Assist in developing benchmarks and evaluation criteria for AI character traits
Contribute to guidelines and documentation for character evaluation
Participate in regular calibration sessions with the team
Quality Standards:
Maintain high levels of precision and consistency in data labeling
Follow annotation guidelines and quality control processes
Participate in regular quality audits and calibration exercises
Document clear rationales for evaluation decisions
Flag edge cases and provide detailed feedback on challenging examples
Required Qualifications:
Bachelor's degree or equivalent experience in relevant field (e.g., linguistics, philosophy, psychology, communications)
Experience with content moderation, data labeling, or quality assessment
Strong attention to detail, analytical and critical thinking skills
Excellent written and verbal communication abilities
Ability to provide nuanced feedback on conversation quality and character traits
Comfortable working independently while maintaining consistent output quality
Required profile
Experience
Spoken language(s):
English
Check out the description to know which languages are mandatory.