Logo for Brunel

AI Trainer: Coding

Role overview

Summary

This role focuses on evaluating and improving AI coding agents by leveraging your software engineering expertise. You will contribute to the development of high-quality AI systems by designing coding tasks and assessing AI performance against established standards. Brunel partners with DataAnnotation to connect you with this innovative AI training program.

Qualifications

  • Fluency in English (native or bilingual level)
  • Hands-on coding experience: you currently write and ship code yourself as an individual contributor, or did so recently.
  • Expertise in at least one common stack, such as TypeScript/JavaScript, Python, Java, Go, Rust, C++, C#, Ruby, PHP, Swift or Kotlin.
  • Comfort working in a terminal with git, tests and a debugger.
  • Preferred: 2+ years of professional software engineering experience shipping and maintaining production code as part of a team.

Responsibilities

  • Design challenging, realistic coding tasks from your own practice.
  • Assemble the codebase and supporting files an engineer would need.
  • Run those tasks through frontier AI coding agents and judge the result against the standard you would hold a teammate to.
  • Write tests, rubrics and success criteria that define a correct result.

Key facts

  • Remote from: United States
  • Full time
  • Mid-level (2-5 years)
  • AI Trainer
  • $77K – $240K / year
  • English

Hard skills

Key skills for this role

Other skills

  • Communication
  • Problem Solving

About the company

Brunel logo

Brunel

  • Staffing & Recruiting
  • XLarge
  • 10,001+
Founded in 1975, we are a global specialist delivering customised project and workforce solutions to drive sustainable industry transformations through technology and talent. With 120+ offices and a powerful network of more than 12,000 specialists around the world, we deliver Project and Consulting Solutions, Workforce Solutions and Global Mobility Solutions that transform global projects in Renewables, Conventional Energy, Mining, Life Sciences, Future Mobility, Industrials & Technology and many other sectors.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Brunel is partnering with DataAnnotation to connect experienced Software Engineers with an innovative AI training program. The program brings together hands-on coding expertise and artificial intelligence to help evaluate and improve how AI coding agents handle real software engineering work inside realistic codebases. Selected experts will contribute their knowledge to the development of high-quality, technically accurate AI systems.

This opportunity is designed for practicing software engineers who currently write, test, debug and ship production code. It covers frontend, backend, full-stack, mobile, systems and infrastructure, DevOps, data engineering, and languages such as TypeScript/JavaScript, Python, Java, Go, Rust, C++, C#, Ruby, PHP, Swift and Kotlin.

Engagement Details

Engagement Fully remote, project-based work with a flexible schedule. The minimum is 10 hours per week, with no weekly maximum. Full-time hours are available.

Pay rate $40–$125 USD/hour, paid via PayPal

Location United States, Canada, United Kingdom, Ireland, and Australia/New Zealand

First step Skills assessment (about 2–4 hours, unpaid)

Responsibilities:

  • Design challenging, realistic coding tasks from your own practice, such as a bug fix with a regression test, a feature built to spec with tests, a refactor that preserves behavior, a pull request review, a debugging write-up from logs and traces, or an API contract with examples
  • Assemble the codebase and supporting files an engineer would need, including repositories, tests, logs, API contracts and design notes
  • Run those tasks through frontier AI coding agents and judge the result (the diff, the tests, the design, the review) against the standard you would hold a teammate to
  • Compare two agent outputs on identical specs and codebases, decide which performed better, and note where each fell short
  • Write tests, rubrics and success criteria that define a correct result, and explain in writing why a submission passes or fails
  • Flag concrete failures with evidence, such as brittle changes, missed edge cases, tests that pass for the wrong reason, thrashing in the trace, fabricated or ignored files, and work that doesn't match the spec
  • Contribute across your own stack and adjacent ones, and review and refine tasks built by other engineers

Qualifications:

  • Fluency in English (native or bilingual level)
  • Hands-on coding experience: you currently write and ship code yourself as an individual contributor, or did so recently, not solely as a manager or architect
  • 2+ years of professional software engineering experience shipping and maintaining production code as part of a team (preferred)
  • Expertise in at least one common stack, such as TypeScript/JavaScript, Python, Java, Go, Rust, C++, C#, Ruby, PHP, Swift or Kotlin. Frontend-only, backend-only and mobile specialists are welcome
  • Comfort working in a terminal with git, tests and a debugger, and the ability to read an unfamiliar codebase and orient quickly. Docker and CI experience is a plus
  • The ability to explain why a result is wrong, not only that it is
  • Working comfort with AI tools such as Claude or ChatGPT. No prior AI or machine learning experience is required
  • A current, in progress, or completed Bachelor's degree. A computer science degree is a plus but not required

Important: The assessment must reflect your own expertise. Submissions produced with AI tools are rejected. The application link only works if you don't have an existing DataAnnotation account. Please use the same email address at every step of the process.

Note: Payment is made via PayPal. We will never ask you for any money. PayPal will handle any currency conversions from USD. Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered for this role. This is an independent contractor position.

#RPOUS

Related jobs

See all AI Trainer jobs

Other jobs at Brunel