We are sharing a specialised consulting opportunity for experienced Senior Software Engineers with strong expertise in system design, code review, debugging, algorithms, data structures, and software architecture to contribute to an advanced AI training and software engineering evaluation project.
Selected professionals will evaluate AI-generated code, create challenging engineering problems and reference solutions, assess reasoning across architecture and debugging scenarios, and provide detailed technical feedback grounded in real-world software engineering practice. The work requires strong technical judgement, rigorous problem-solving ability, and the ability to explain complex engineering decisions clearly in writing.
Key Responsibilities
AI-Generated Code Evaluation
-
Review AI-generated code for correctness, quality, maintainability, and design
-
Identify bugs, logical errors, poor abstractions, and implementation weaknesses
-
Assess whether solutions handle relevant edge cases and constraints
-
Evaluate code quality against professional software engineering standards
-
Distinguish functionally correct solutions from implementations with architectural or maintainability issues
Coding Problems & Reference Solutions
-
Create challenging software engineering and coding problems
-
Develop high-quality reference solutions demonstrating robust engineering practice
-
Design comprehensive test cases covering expected behaviour, edge cases, and failure conditions
-
Apply algorithms and data structures appropriately to problem requirements
-
Ensure tasks meaningfully test advanced engineering capability rather than superficial syntax knowledge
System Design & Architecture Review
-
Evaluate model reasoning involving system design and software architecture
-
Assess scalability, reliability, maintainability, and technical trade-offs
-
Identify architectural weaknesses, unrealistic assumptions, or missing system constraints
-
Compare alternative designs and explain relevant engineering compromises
-
Apply practical judgement grounded in production software environments
Debugging & Technical Reasoning
-
Review AI reasoning across debugging and troubleshooting scenarios
-
Identify incorrect diagnoses, incomplete root-cause analysis, and unsupported conclusions
-
Analyse complex software failures and recommend robust corrective approaches
-
Evaluate whether proposed fixes introduce regressions or long-term maintenance risks
-
Provide clear explanations of technical decisions and debugging methodology
Expert Feedback & Model Improvement
-
Deliver detailed technical feedback on AI-generated solutions and reasoning
-
Explain strengths, weaknesses, and potential improvements precisely
-
Identify recurring patterns of technical failure or weak reasoning
-
Contribute high-quality evaluation material that improves model performance
-
Maintain consistent review standards across diverse engineering scenarios
Ideal Profile
-
At least 1 year of professional experience as a software engineer at a top-tier or highly regarded technology company
-
At least part of the relevant engineering experience should have been gained within approximately the past 7 years
-
Strong expertise in system design and software architecture
-
Excellent code-review and debugging skills
-
Deep understanding of algorithms and data structures
-
Strong ability to reason about correctness, scalability, maintainability, and performance
-
Experience developing or reviewing production-grade software systems
-
Ability to create rigorous coding problems, reference solutions, and test cases
-
Excellent written communication and ability to explain technical decisions clearly
-
Undergraduate degree from a highly ranked university is preferred
-
Candidates based in English-speaking countries are preferred
Engagement Details
-
Independent contractor engagement
-
Fully remote
-
Compensation: $245–$280/hour
-
Work will involve AI-generated code evaluation, engineering problem creation, reference-solution development, system-design review, debugging, and technical feedback
-
Strong professional software engineering experience and written technical communication are central to this engagement
-
Assignments may involve algorithms, data structures, architecture, debugging, code quality, and production engineering scenarios
-
Project scope, workload, technical focus, and evaluation standards may evolve depending on project requirements
-
Work must be completed without using confidential or proprietary information belonging to any employer, client, technology company, institution, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy
