We are sharing a specialised part-time consulting opportunity for experienced software engineering professionals with strong expertise in technical analysis, architecture, documentation, quality assurance, prompt development, AI-output evaluation, and structured technical reasoning to contribute to an advanced AI training and software-engineering evaluation project.
Selected professionals will review and improve AI-generated technical content, design and refine prompts, evaluate model outputs against detailed rubrics, and contribute high-quality engineering documentation and analysis. The work is suited to experienced Software Engineers, Staff Engineers, Technical Leads, Engineering Managers, Solutions Architects, and similar professionals with strong technical judgement and communication skills. No prior experience in AI is required.
Key Responsibilities
Technical Content Evaluation
-
Review AI-generated software-engineering content for accuracy, clarity, and completeness
-
Evaluate technical recommendations against established engineering best practices
-
Identify incorrect assumptions, architectural weaknesses, or incomplete reasoning
-
Assess whether technical outputs are practical and internally consistent
-
Provide structured feedback supporting measurable improvements in quality
Prompt Development & Refinement
-
Create prompts and instructions for complex software-engineering tasks
-
Refine existing prompts to improve clarity, scope, and technical depth
-
Design tasks that test analytical reasoning and engineering judgement
-
Evaluate how prompt structure influences model behaviour and output quality
-
Contribute to development of robust software-engineering evaluation scenarios
Rubric-Based AI Evaluation
-
Assess AI-generated outputs using detailed evaluation rubrics
-
Evaluate correctness, completeness, relevance, and technical quality
-
Apply consistent judgement across repeated evaluation tasks
-
Identify edge cases or ambiguities requiring additional interpretation
-
Provide clear written justification for evaluation decisions
Technical Documentation & Architecture
-
Draft and review technical documentation
-
Develop and evaluate architecture plans
-
Review RFCs, design specifications, and engineering proposals
-
Improve technical materials for structure, clarity, and precision
-
Ensure documentation reflects sound software-engineering reasoning and implementation considerations
Software Engineering Analysis
-
Apply professional engineering judgement to technical scenarios
-
Evaluate architectural and implementation trade-offs
-
Analyse system-design and software-development decisions
-
Identify maintainability, scalability, reliability, and performance considerations
-
Translate complex engineering concepts into clear analytical conclusions
Research & Technical Fact Checking
-
Conduct independent research to validate technical assertions
-
Fact-check engineering concepts, technologies, and implementation claims
-
Compare outputs against reliable technical documentation where appropriate
-
Identify outdated, unsupported, or misleading technical information
-
Maintain high standards of technical accuracy throughout project work
Data Annotation & Content Review
-
Interpret and annotate technical data and engineering content
-
Support nuanced labelling and evaluation workflows
-
Review content against project-specific standards and rubrics
-
Identify inconsistencies across datasets or evaluation examples
-
Contribute to quality-assurance and calibration processes
Professional & Technical Writing
-
Produce clear professional and technical written materials
-
Edit complex engineering content for accuracy and readability
-
Improve technical reports, documentation, and analytical summaries
-
Adapt explanations for technical and non-technical audiences
-
Maintain consistent editorial and technical standards
Ideal Profile
-
3+ years of professional software-engineering experience
-
Background as a Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, Solutions Architect, or comparable role
-
Strong critical-thinking and analytical-reasoning skills
-
Demonstrated ability to solve complex technical problems logically
-
Strong attention to detail and commitment to quality assurance
-
Experience authoring or reviewing technical documentation
-
Familiarity with architecture documents, design specifications, RFCs, engineering proposals, postmortems, technical blogs, or code reviews
-
Excellent written communication and technical-editing skills
-
Ability to communicate sophisticated engineering concepts clearly
-
Experience with prompt authoring, content evaluation, data annotation, or rubric-based assessment is advantageous
-
Familiarity with AI coding assistants or automated documentation tools is beneficial but not required
-
Experience with AI-model evaluation, RLHF, or prompt engineering is advantageous
-
Advanced academic qualifications such as a Master's, JD, MBA, or PhD are valued but not required
-
No prior AI-training experience is required
Engagement Details
-
Part-time independent contractor engagement
-
Fully remote
-
Compensation: $100–$200/hour
-
Work will involve software-engineering analysis, technical-content review, prompt development, rubric-based evaluation, technical documentation, architecture analysis, research, fact checking, and AI-output assessment
-
Strong engineering judgement, analytical reasoning, and technical-writing ability are central to this engagement
-
Assignments may involve architecture documents, RFCs, design specifications, engineering proposals, technical reports, code-review materials, model outputs, and structured evaluation rubrics
-
Collaboration will primarily occur asynchronously with project leads and other subject-matter experts
-
Prior experience with AI tools or model evaluation is helpful but not required
-
Project scope, workload, technical topics, and evaluation standards may evolve depending on project requirements
-
Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy
