We are sharing a specialised short-term consulting opportunity for experienced professionals in business operations, marketing, human resources, or accounting to participate in a structured professional work evaluation study.
Selected experts will complete one realistic task in their area of expertise and then independently assess five alternative attempts at the same task. The study is designed to capture authentic professional judgement, including how experienced practitioners rank work quality, identify strengths and weaknesses, and explain their decisions using specific evidence.
Key Responsibilities
Domain-Specific Task Completion
-
Complete one realistic professional task within your primary area of expertise
-
Work from the source files and instructions provided for the assignment
-
Produce a complete professional-quality deliverable using your normal judgement and working methods
-
Approach the task as you would in a real business environment
-
Complete the assignment independently within the required turnaround window
Comparative Work Evaluation
-
Review five separate outputs produced for the same task
-
Rank all five outputs from 1 to 5 with no ties
-
Assign each output a numerical score from 0–100
-
Evaluate accuracy, completeness, usefulness, reasoning, and overall professional quality
-
Identify meaningful differences between stronger and weaker submissions
Evidence-Based Assessment
-
Write clear rationales supporting each ranking and score
-
Cite specific sections or elements of the reviewed work as evidence
-
Explain material strengths, errors, omissions, and weaknesses
-
Apply experienced professional judgement rather than generic evaluation criteria
-
Ensure feedback is specific enough to explain why one output performs better than another
Study & Task Feedback
-
Provide structured feedback on the assigned task
-
Comment on task realism, clarity, difficulty, and professional relevance
-
Provide feedback on the evaluation process and overall study design
-
Highlight ambiguities or issues that materially affect professional judgement
-
Contribute observations grounded in current or recent industry practice
Relevant Business Domains
Participants will be selected from one of the following areas:
-
Administration / Business Operations
-
Marketing
-
Human Resources
-
Accounting
Ideal Profile
-
5+ years of hands-on professional experience in at least one of the four target domains
-
Current or recent professional experience in the relevant field
-
Strong practical understanding of how high-quality professional work is produced and evaluated
-
Ability to distinguish substantive quality differences across multiple work products
-
Strong analytical judgement and attention to detail
-
Ability to write clear, specific, evidence-grounded rationales
-
Comfortable working independently and meeting a short turnaround requirement
-
Reliable and able to complete all required components of the study
Engagement Details
-
Short-term independent contractor engagement
-
Fully remote
-
One-time evaluation study rather than ongoing production work
-
Total expected commitment of up to approximately 13 hours
-
Approximately 3–10 hours to complete the assigned professional task
-
Approximately 2 hours to rank and score five submitted outputs
-
Approximately 1 hour to provide structured study feedback
-
Compensation: $50–$70/hour
-
NDA must be completed before project materials are provided
-
No predefined rubric or reference answer is provided; participants' professional judgement is the primary evaluation standard
-
Use of LLMs or other AI assistants is prohibited throughout the study, including task completion, ranking, scoring, and written rationale preparation
-
Candidates who have previously worked on Project Alchemy in any capacity, or had access to its source-world data, are not eligible for this study
-
Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
-
H1-B and STEM OPT support is unavailable for this engagement
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.
