Offer summary

Qualifications:

Bachelor's degree or equivalent in Computer Science or related field., At least 5 years of professional software development experience., Proficiency in multiple programming languages such as Python, JavaScript, and Rust., Strong understanding of data structures, algorithms, and system architecture..

Key responsibilities:

Design and implement data collection systems and pipelines for AI training.

Architect and evaluate datasets for AI model benchmarking.

Analyze model behaviors, performance, and interaction patterns.

Develop and curate code examples and evaluation frameworks.

Job description

Lead Stack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world.

TITLE: AI/ML Software developer
LOCATION: Remote in USA
DURATION: 6-Month Contract with possible extension
No C2C
GC/USC preferred
Rate: $90-$100/hr on W2

Description:

We are seeking experienced Software Engineers to develop and evaluate high-quality training data for our advanced AI models. As part of the Human Data Operations team, you will architect, analyze, and curate sophisticated datasets that facilitate the training of large language models. You will work closely with our research and engineering teams to ensure our AI systems demonstrate key traits like helpfulness, honesty, and harmlessness while maintaining technical excellence.

Key Responsibilities:

Design and implement data collection systems and pipelines for AI model training
Architect and evaluate datasets for AI model training and benchmarking
Provide in-depth analysis of model behaviors, performance, and interaction patterns
Develop and curate complex code examples and solutions in multiple languages (Python, JavaScript, Rust, C/C++)
Lead evaluation efforts of AI-generated code to enforce industry-leading standards
Identify and analyze emerging trends, edge cases, and opportunities for improvement
Develop advanced benchmarks and evaluation methodologies for AI capabilities
Create technical documentation and evaluation frameworks

Quality Standards:

Maintain high levels of precision and consistency in data labeling and code evaluation
Follow annotation guidelines and quality control processes
Participate in regular quality audits and calibration exercises
Document clear rationales for evaluation decisions
Flag edge cases and provide detailed feedback on challenging examples

Required Qualifications:

Bachelor's degree or equivalent experience in Computer Science, Software Engineering, or related technical field
5+ years of professional software development experience
Expert proficiency in multiple programming languages (Python, JavaScript, Rust)
Strong full-stack development experience across frontend and backend systems
Advanced understanding of data structures, algorithms, and system architecture
Experience with ML/AI systems, preferably language models or related technologies
Strong attention to detail with exceptional analytical and critical thinking skills
Outstanding written and verbal communication abilities
Proven ability to work independently while delivering high-quality output

Preferred Qualifications:

Master's degree in Computer Science, AI, or related field

Experience with AI language models, prompt engineering, or model evaluation
Deep knowledge of machine learning frameworks and concepts
Previous experience developing tooling for data labeling or annotation platforms
Expertise in cloud infrastructure (AWS, GCP, Azure) and containerization (Docker, Kubernetes)
Experience with distributed systems and high-performance computing
Understanding of ethical considerations in AI development

To know more about current opportunities at Lead Stack, please visit us at https://leadstackinc.com/careers/
Should you have any questions, feel free to call me on 415 985-0816 or send an email on Nishanth.allam@leadstackinc.com

Required profile