We are sharing a specialised part-time consulting opportunity for analytical professionals with strong critical-reading, reasoning, and written-evaluation skills.
This role focuses on reviewing AI-generated responses, identifying weaknesses in reasoning and communication, and producing clear, evidence-based assessments against structured evaluation guidelines. Selected contributors will apply careful independent judgement to nuanced written material across a range of topics.
Key Responsibilities
Response Evaluation
-
Review AI-generated responses for quality, accuracy, relevance, and reasoning
-
Assess whether responses address the underlying task completely and appropriately
-
Identify logical gaps, unsupported conclusions, inconsistencies, and missed nuances
-
Evaluate both explicit content and important implications or assumptions
-
Apply careful professional judgement rather than relying on surface-level characteristics
Critical Reading & Reasoning
-
Analyse complex written material closely and systematically
-
Identify subtle differences in reasoning, interpretation, and argument quality
-
Detect implicit meaning, missing considerations, and weak assumptions
-
Distinguish substantive errors from minor stylistic issues
-
Evaluate whether conclusions are adequately supported by the available information
Written Evaluation & Rationale
-
Produce clear, precise, and well-supported written rationales
-
Explain evaluation decisions using specific evidence from the reviewed material
-
Provide substantive feedback that goes beyond general or surface-level observations
-
Communicate weaknesses and strengths objectively and concisely
-
Ensure written assessments remain internally consistent and easy to follow
Structured Quality Review
-
Apply detailed evaluation guidelines accurately and consistently
-
Maintain strict attention to task requirements and scoring criteria
-
Make independent judgements when responses are ambiguous or closely matched
-
Provide critical assessments when quality standards are not met
-
Maintain consistency across repeated evaluation tasks
Independent Task Execution
-
Follow detailed project instructions without continuous supervision
-
Complete assigned evaluations independently and accurately
-
Maintain high standards of concentration and attention to detail
-
Adapt to different task formats and evaluation frameworks
-
Complete all work without the use of AI writing or assistance tools
Ideal Profile
-
Strong analytical and critical-reading skills
-
Ability to identify nuance, implicit meaning, reasoning gaps, and unsupported claims
-
Excellent written communication and ability to produce precise, evidence-grounded rationales
-
Strong attention to detail and ability to apply structured evaluation criteria consistently
-
Sound independent judgement and willingness to provide critical assessments where warranted
-
Ability to work independently and follow detailed task instructions
-
Native English fluency required
-
Bachelor's degree from a top-500 globally ranked university is preferred
-
Comfortable completing all evaluation and written-feedback work without AI writing tools
Engagement Details
-
Part-time independent contractor engagement
-
Fully remote
-
Flexible scheduling based on project requirements
-
Compensation: Up to $60/hour
-
Work includes evaluation of AI-generated responses and preparation of structured written feedback
-
Use of AI writing tools or other AI assistance is prohibited when completing project work
-
Projects may be extended, shortened, or concluded based on project needs and performance
-
Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
-
H1-B and STEM OPT support is unavailable for this engagement
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.
