This role is for one of our clients
Compensation: $80-$150 per hour
1. Role Overview
We are seeking experienced marketing and advertising professionals to contribute to a research initiative focused on evaluating how effectively advanced AI systems perform real-world marketing work.
In this role, you will use your professional marketing expertise to define what high-quality work looks like. Rather than simply producing marketing deliverables, you will create task-specific evaluation criteria, assess AI-generated and human work samples, and provide rigorous, well-reasoned written justifications for your assessments.
Your industry experience will help establish practical standards for evaluating marketing strategy, creative quality, brand thinking, messaging, and campaign development.
Requirements
2. Key Responsibilities
- Develop precise, task-specific grading criteria for real-world marketing deliverables, including:
- Creative briefs
- Campaign concepts and presentations
- Brand positioning and messaging frameworks
- Advertising copy and scripts
- Integrated marketing campaign plans
- Client-ready presentations
-
- Evaluate AI-generated and human-produced marketing work against defined criteria and provide detailed written justifications for each assessment.
- Assess whether creative and strategic work effectively addresses the original brief, target audience, brand objectives, and business goals.
- Apply consistent, evidence-based judgment to ensure evaluation results are reproducible and defensible.
- Identify strengths, weaknesses, inconsistencies, and gaps in marketing strategies and creative outputs.
- Incorporate structured feedback from senior reviewers and continuously refine evaluation frameworks.
- Translate practical marketing judgment into clear, structured criteria that can be consistently applied across different projects and deliverables.
3. Ideal Qualifications
- 5+ years of professional experience in marketing, advertising, brand strategy, or a closely related field.
- Experience as a Creative Director, Account Lead, Brand Strategist, Marketing Leader, or similar professional.
- Background at leading global creative agencies or in senior brand/marketing roles at established consumer-facing companies.
- Strong understanding of the day-to-day marketing craft, including:
- Developing and evaluating creative briefs
- Campaign strategy and development across multiple channels
- Brand positioning
- Messaging strategy
- Creative concept evaluation
- Connecting creative work to business objectives
-
- Ability to critically evaluate marketing work against a brief, target audience, brand strategy, and measurable business objective.
- Exceptional written communication skills, with the ability to clearly explain why a marketing deliverable meets or falls short of professional standards.
- Highly detail-oriented, consistent, and comfortable having professional judgment reviewed and calibrated against experienced peers.
- Prior experience with AI training, model evaluation, human-data projects, or AI-assisted workflows is a strong plus.
- Specialized experience in media planning, media buying, or marketing measurement is not required for this opportunity.
4. Application Process
- Submit your resume or relevant professional background to begin the application process.
- Qualified candidates may be asked to complete a brief marketing assessment or provide additional information about their professional experience.
- Selected candidates may be evaluated based on their ability to apply professional marketing judgment consistently and articulate their reasoning clearly.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote opportunity with flexible scheduling.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- The engagement will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through available payment platforms.
- H-1B and STEM OPT candidates are not currently supported.
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
