About the Company
Outlier is an AI training platform owned and operated by Scale AI. It connects subject-matter experts and contributors with projects that help train and evaluate advanced AI models.
About the Role
Outlier is seeking detail-oriented English speakers to evaluate AI-generated media, including voice conversations, images, and videos. Contributors will interact with AI voice models, compare generated media against prompts, identify quality issues, and provide clear, evidence-based feedback.
This is a remote freelance opportunity with a flexible schedule and no minimum weekly hours. Contributors may work on different evaluation and labeling tasks depending on project availability and requirements.
Key Responsibilities
Conduct live, scenario-based conversations in English with AI voice models and evaluate their naturalness, usefulness, and clarity.
Compare AI-generated images and videos to determine which output better follows the given prompt.
Inspect visual and audio content closely, replaying or zooming in when necessary to identify errors and inconsistencies.
Identify issues such as distorted anatomy, unnatural movement, flickering, text errors, and mismatched audio.
Rate outputs based on prompt adherence, quality, realism, and other evaluation criteria.
Write specific explanations in English describing the issues observed in each output.
Evaluate AI-generated images, including edited images compared with original versions.
Review AI-generated videos against text prompts or source clips.
Label first-person videos of people or robots performing hands-on tasks by identifying individual actions and writing accurate captions.
Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice.
Record short voice explanations when required by a project.
Common Project Tasks
Image evaluation, including prompt adherence, visual quality, and AI-generated artifacts.
Video evaluation, including prompt alignment, visual consistency, and comparison with source footage.
Video caption labeling, including reviewing AI-generated drafts and correcting action descriptions.
Audio and voice evaluation, including speech naturalness, pronunciation, and voice consistency.
Ideal Qualifications
Fluent English speaker with strong written communication skills and confidence in everyday conversation.
Excellent attention to detail and patience when reviewing visual and audio content.
Ability to think quickly and respond naturally in realistic conversational scenarios.
Experience writing concise, evidence-based explanations, reviews, or evaluations.
Ability to make clear judgments when comparing outputs, even when both have flaws.
A bachelor’s degree or higher is a plus.
Sign-Up Requirements
Valid government-issued ID and a mobile phone from the country of residence.
An up-to-date resume highlighting relevant experience and expertise.
A LinkedIn profile showing educational background and work experience.
Compensation & Payment
Project-based earnings of up to USD $15 per hour.
Additional incentives through Missions, Outlier’s surge-pricing program. Contributors earn an average additional 7.5%, while top-quartile contributors receive an average earnings increase of 11%.
Payments are processed weekly on Tuesdays for tasks completed during the previous pay period, which runs from Tuesday through Monday at midnight UTC.
Payment methods include PayPal, AirTM, and ACH transfer.
Rates vary based on expertise, skills assessment, location, project requirements, and other factors. Higher rates may be available for advanced qualifications, such as PhDs.
Lower rates may apply to non-core work, including initial project onboarding and project overtime phases.
Some projects offer additional incentive payments, subject to their individual payment terms.
Benefits & Work Arrangement
Fully remote freelance work that can be completed from anywhere within an eligible country.
Flexible schedule with no minimum hours; contributors can choose to work five hours or 40+ hours per week.
Free access to leading large language models (LLMs), valued at over $200 per month.
Opportunity to collaborate with experts and contribute to the evaluation of pre-release AI models.
Join a contributor community of more than 900,000 Outlier Experts across 52 countries.
Eligible Countries
Currently accepting applicants residing in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Employment Type & Work Authorization
This is a 1099 freelance/independent contractor opportunity through the Outlier.ai platform, not an employee position.
Internships, visa sponsorship, and employment are not offered.
Applicants must be authorized to work in their country of residence.
International students may be eligible to sign up depending on their visa status. Applicants should consult a tax or immigration advisor regarding their individual circumstances.
#J-18808-Ljbffr

Torentify is hiring: Video Editor – AI Video Evaluation (Remote) in New York
Torentify · New York, NY, USA · Remote ·
- Pay:
- $15 per hour
- Job type:
- Contract