Offer summary

Qualifications:

5-7+ years of Python development experience, Deep expertise in Python syntax, testing, and debugging, Experience with Docker for containerized testing, Background in QA processes and review pipelines.

Key responsibilities:

Review and validate AI-generated Python code for accuracy and functionality

Assess annotator evaluations to ensure quality standards are met

Provide feedback and document technical issues during code reviews

Validate code using sandbox environments and contribute to process improvements

Job description

Company Description

BETSOL is a cloud-first digital transformation and data management company offering products and IT services to enterprises in over 40 countries. BETSOL team holds several engineering patents, is recognized with industry awards, and BETSOL maintains a net promoter score that is 2x the industry average.

BETSOL’s open source backup and recovery product line, Zmanda (Zmanda.com), delivers up to 50% savings in total cost of ownership (TCO) and best-in-class performance.

BETSOL Global IT Services (BETSOL.com) builds and supports end-to-end enterprise solutions, reducing time-to-market for its customers.

BETSOL offices are set against the vibrant backdrops of Broomfield, Colorado and Bangalore, India.

We take pride in being an employee-centric organization, offering comprehensive health insurance, competitive salaries, 401K, volunteer programs, and scholarship opportunities. Office amenities include a fitness center, cafe, and recreational facilities.

Job Description

We are seeking experienced Python developers to join an exciting AI project supporting one of the world's top 15 companies. This role involves reviewing and validating AI-generated code to ensure quality, accuracy, and adherence to industry standards.

As a Python Code Reviewer, you will be responsible for auditing and validating AI-generated Python code evaluations. This critical role ensures that AI outputs meet high standards for functionality, clarity, and correctness while adhering to specific project guidelines.

Key Responsibilities

Code Review & Validation: Evaluate AI-generated Python code snippets for accuracy, functionality, and adherence to prompt instructions
Quality Assurance: Review annotator assessments and ensure all evaluations meet internal quality benchmarks
Feedback & Documentation: Provide clear, actionable feedback on incorrect assessments and document technical issues
Testing & Validation: Validate code functionality using proof-of-work methodologies and Docker-based sandbox environments
Process Improvement: Identify patterns in evaluation errors and contribute to continuous quality enhancement
Compliance: Ensure all reviews align with established project guidelines and frameworks

Qualifications

Required Qualifications

Technical Requirements

5-7+ years of hands-on Python development experience
Deep Python expertise including syntax, testing strategies, debugging, and edge case handling
Docker experience for containerized testing and isolated code validation environments
QA background with structured workflows, annotation processes, or similar review pipelines

Professional Requirements

Excellent written communication skills with ability to document and explain technical concepts clearly
Professional English fluency (B2+ level or above)
Independent work capability with strong attention to detail
Immediate availability to start

Preferred Qualifications

Experience with AI/ML model evaluation, reinforcement learning (RLHF), or large language model tuning
Familiarity with annotation tools or data labeling platforms
Knowledge of secure coding practices and environment replication
Previous experience in code review or technical auditing roles

Required profile