Mediabistro logo
job logo

Freelance Technical Writer - Generalist AI Reviewer

Uber AI Solutions, New York, NY, USA

Pay: $30/hr

Job type: Contract


Uber AI Solutions

is Uber’s marketplace connecting skilled freelancers with Generative AI researchers and product teams working on cutting‑edge AI systems. We partner with independent contractors to support large‑scale model evaluation, alignment, and quality initiatives.

We are seeking

analytical, detail‑oriented reviewers

to evaluate AI‑generated responses across a broad range of general knowledge and Generative AI (GenAI) topics. In this role, you will assess model outputs across multiple quality dimensions, including

truthfulness, completeness, and insightfulness , helping ensure AI systems meet high standards of accuracy and reliability.

This is a

remote, contract‑based position

offering flexible hours and the opportunity to work on cutting‑edge AI alignment and evaluation initiatives.

What you’ll work on

Review prompt/context and model responses : Analyze the relationship between user inputs and AI outputs.

Compare multiple outputs : Identify which responses best meet the established criteria.

Evaluate responses across rubric dimensions : Score responses for factual accuracy, truthfulness, naturalness, completeness, and depth of insight.

Select preferences : Use your editorial judgment to choose the highest quality response where applicable.

Provide written justification : Write short, structured explanations for your ratings.

Identify model gaps : Flag hallucinations, missing context, or low‑quality responses.

Follow instructions : Apply guidelines precisely and consistently across varying tasks.

Who we’re looking for

Bachelor’s degree or more.

Experience reviewers who bring rigor, consistency, and strong analytical judgment to AI evaluation work.

Prior experience in

GenAI / LLM response evaluation

is required.

Highly analytical with a strong focus on

factuality and accuracy .

Comfortable working independently in high‑volume, task‑based environments.

Detail‑oriented with the ability to follow structured guidelines.

Tech‑savvy with solid computer literacy.

Schedule : Fully flexible. Work from any time zone, for 5‑40 hours a week.

Engagement : Long‑term opportunity with approximately 10,000 tasks available.

Task duration : Each task is estimated to take about 15 minutes.

Location : Remote (US‑based only).

Payment type : 1099 independent contractor, paid through the Uber AI Solutions portal.

Pay rate: up to $30/hr*

Why this work matters
Your contributions directly impact the quality, trustworthiness, and reliability of Generative AI systems used at scale. By improving how AI models evaluate and present information, your work helps advance responsible AI development and real‑world AI performance.

#J-18808-Ljbffr