Match score not available

Legal Prompt Generation and Annotation Specialist (English)

extra holidays - extra parental leave
Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

Native-level fluency in English., Strong background in Law with a degree., Experience in analyzing complex legal issues., Ability to spot errors in legal reasoning., Familiarity with AI/ML models is a plus..

Key responsabilities:

  • Develop intricate legal scenarios for AI prompts.
  • Evaluate AI-generated legal analyses for accuracy.
  • Ensure prompts require nuanced legal reasoning.
  • Provide feedback for AI performance improvement.
  • Integrate multiple legal concepts in challenges.
appen logo
appen Scaleup https://appen.com/
501 - 1000 Employees
HQ: Sydney
See more appen offers

Job description

Join the CrowdGen team as an Independent Contractor for Project Aristotle Legal. We are seeking a Legal expert to develop complex, skill-based prompts and evaluate AI responses for legal accuracy and logical soundness. This role emphasizes creating challenging legal problems that test advanced AI models, ensuring they require nuanced legal reasoning and the application of multiple areas of law.

Key Responsibilities:
- Legal-Focused Prompt Generation: Develop intricate legal scenarios or problems that combine multiple areas of law (e.g., contract law and torts) to challenge advanced AI models like GPT-40.
- AI Response Evaluation: Review AI-generated legal analyses, identifying errors in legal reasoning, statutory interpretation, or case law application.
- Skill Integration: Ensure each prompt integrates multiple legal concepts, requiring the AI to apply them in complex and non-trivial ways.
- Model Refinement: Provide detailed feedback on the AI’s performance, contributing to its improvement in addressing complex legal questions and producing accurate legal analyses.

Qualifications:
- Native-level fluency in English.
- Strong background in Law, ideally with a law degree (JD, LLB, or equivalent) and legal practice experience.
- Experience creating or analyzing complex legal issues across multiple fields (e.g., constitutional law, corporate law, intellectual property).
- Ability to spot and explain errors in legal reasoning, interpretation, or case law application.
- Familiarity with AI/ML models and their limitations is a plus.

This is a project-based role with CrowdGen, where you will join the community as an Independent Contractor. Upon selection, you will receive an email with instructions to create an account, reset your password, and complete the onboarding process.

This role is ideal for someone with deep legal expertise who is passionate about contributing to the advancement of AI systems in understanding and applying legal principles.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
EnglishEnglish
Check out the description to know which languages are mandatory.

Other Skills

  • Analytical Thinking
  • Verbal Communication Skills

Related jobs