Remote Legal Expert - AI Trainer ($105-$105 per hour)
Mercor, Buffalo, New York, United States, 14266
Job Details
Location: Geography restricted to USA, EU, UK, Canada. Type: Full-time or Part-time Contract Work.
Fluent Language Skills Required: English.
Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general‑purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses. Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real‑world legal practice.
What You’ll Do
Write and refine prompts to guide model behavior in legal use cases
Evaluate LLM‑generated responses to legal queries for accuracy, reasoning, clarity, and completeness
Conduct fact‑checking using trusted public sources and authoritative references
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
Assess tone, completeness, and appropriateness of responses for real‑world legal scenarios
Ensure model responses align with expected conversational behavior and system guidelines
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Who You Are You have a minimum of 5 years of real‑world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent).
Experience in one or more of the following sub‑domains:
Corporate, Business & Commercial Law
Employment, Labor & Human Rights
Public, Criminal & International Governance
Private Law
Significant experience using large language models (LLMs) and understand how and why people use them
Excellent writing skills and can clearly explain complex legal concepts
Comfortable evaluating complex arguments and identifying subtle reasoning or detail‑level issues that others may overlook
Nice‑to‑Have Specialties
Prior experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high‑quality legal or analytical content
Experience translating legal concepts for non‑legal audiences
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
What Success Looks Like
You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs
Your evaluations improve the reliability and clarity of legal AI responses
You deliver structured, reproducible feedback that meaningfully improves model performance
Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them
Why Join Mercor Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high‑impact projects.
Compensation Remote Legal Expert AI Trainer – $105,105 per hour • Buffalo, New York, US
#J-18808-Ljbffr
Fluent Language Skills Required: English.
Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general‑purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses. Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real‑world legal practice.
What You’ll Do
Write and refine prompts to guide model behavior in legal use cases
Evaluate LLM‑generated responses to legal queries for accuracy, reasoning, clarity, and completeness
Conduct fact‑checking using trusted public sources and authoritative references
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
Assess tone, completeness, and appropriateness of responses for real‑world legal scenarios
Ensure model responses align with expected conversational behavior and system guidelines
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Who You Are You have a minimum of 5 years of real‑world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent).
Experience in one or more of the following sub‑domains:
Corporate, Business & Commercial Law
Employment, Labor & Human Rights
Public, Criminal & International Governance
Private Law
Significant experience using large language models (LLMs) and understand how and why people use them
Excellent writing skills and can clearly explain complex legal concepts
Comfortable evaluating complex arguments and identifying subtle reasoning or detail‑level issues that others may overlook
Nice‑to‑Have Specialties
Prior experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high‑quality legal or analytical content
Experience translating legal concepts for non‑legal audiences
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
What Success Looks Like
You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs
Your evaluations improve the reliability and clarity of legal AI responses
You deliver structured, reproducible feedback that meaningfully improves model performance
Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them
Why Join Mercor Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high‑impact projects.
Compensation Remote Legal Expert AI Trainer – $105,105 per hour • Buffalo, New York, US
#J-18808-Ljbffr