Uber AI Solutions
is Uber’s marketplace connecting skilled freelancers with Generative AI researchers and product teams working on cutting‑edge AI systems. We partner with independent contractors to support large‑scale model evaluation, alignment, and quality initiatives.
We are seeking
analytical, detail‑oriented reviewers
to evaluate AI‑generated responses across a broad range of general knowledge and Generative AI (GenAI) topics. In this role, you will assess model outputs across multiple quality dimensions, including
truthfulness, completeness, and insightfulness , helping ensure AI systems meet high standards of accuracy and reliability.
This is a
remote, contract‑based position
offering flexible hours and the opportunity to work on cutting‑edge AI alignment and evaluation initiatives.
What you’ll work on
Review prompt/context and model responses : Analyze the relationship between user inputs and AI outputs.
Compare multiple outputs : Identify which responses best meet the established criteria.
Evaluate responses across rubric dimensions : Score responses for factual accuracy, truthfulness, naturalness, completeness, and depth of insight.
Select preferences : Use your editorial judgment to choose the highest quality response where applicable.
Provide written justification : Write short, structured explanations for your ratings.
Identify model gaps : Flag hallucinations, missing context, or low‑quality responses.
Follow instructions : Apply guidelines precisely and consistently across varying tasks.
Who we’re looking for
Bachelor’s degree or more.
Experience reviewers who bring rigor, consistency, and strong analytical judgment to AI evaluation work.
Prior experience in
GenAI / LLM response evaluation
is required.
Highly analytical with a strong focus on
factuality and accuracy .
Comfortable working independently in high‑volume, task‑based environments.
Detail‑oriented with the ability to follow structured guidelines.
Tech‑savvy with solid computer literacy.
Schedule : Fully flexible. Work from any time zone, for 5‑40 hours a week.
Engagement : Long‑term opportunity with approximately 10,000 tasks available.
Task duration : Each task is estimated to take about 15 minutes.
Location : Remote (US‑based only).
Payment type : 1099 independent contractor, paid through the Uber AI Solutions portal.
Pay rate: up to $30/hr*
Why this work matters
Your contributions directly impact the quality, trustworthiness, and reliability of Generative AI systems used at scale. By improving how AI models evaluate and present information, your work helps advance responsible AI development and real‑world AI performance.
#J-18808-Ljbffr

Freelance Technical Writer - Generalist AI Reviewer
Uber AI Solutions, New York, NY, USA
Pay: $30/hr
Job type: Contract