Offer summary

Qualifications:

At least 3 years of professional experience in Cobol programming., Strong code-review skills with the ability to identify errors and performance issues., Excellent written communication skills and attention to detail., Ability to explain technical concepts clearly in an asynchronous work environment..

Key responsibilities:

Review and critique AI-generated code snippets for correctness and efficiency.

Compare and rank multiple code snippets, explaining the rationale.

Refactor and repair code to improve quality, performance, and style.

Provide detailed feedback to support reinforcement learning of language models.

Job description

Software Engineer, AI — Code Evaluation & Training (Remote)

List of accepted countries and locations

Help train large-language models (LLMs) to write production-grade code across a wide range of programming languages:

Compare & rank multiple code snippets, explaining which is best and why.
Repair & refactor AI-generated code for correctness, efficiency, and style.
Inject feedback (ratings, edits, test results) into the RLHF pipeline and keep it running smoothly.
End result: the model learns to propose, critique, and improve code the way you do.

RLHF in one line
Generate code ➜ expert engineers rank, edit, and justify ➜ convert that feedback into reward signals ➜ reinforcement learning tunes the model toward code you’d actually ship.

What You’ll Need

3+ years of professional software engineering experience in Cobol
(Constraint programming experience is a bonus, but not required)
Strong code-review instincts—you can spot logic errors, performance traps, and security issues quickly.
Extreme attention to detail and excellent written communication skills.
Much of this role involves explaining why one approach is better than another. This cannot be overstated.
You enjoy reading documentation and language specs and thrive in an asynchronous, low-oversight environment.

What You Don’t Need

No prior RLHF (Reinforcement Learning with Human Feedback) or AI training experience.
No deep machine learning knowledge. If you can review and critique code clearly, we’ll teach you the rest.