Mediabistro logo
job logo

Search Quality Evaluator

Alignerr · New York, NY, USA ·

Pay:
20.664 - 34.440
Job type:
Contract

About The Role
What if your everyday curiosity and judgment could directly influence how AI finds and presents information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and recommendations — helping ensure that the AI systems people rely on every day are accurate, relevant, and genuinely useful.

This is a fully remote, flexible contract role open to anyone with a sharp eye for quality and strong critical thinking skills. No technical background required — if you use the internet and have an instinct for what makes a good answer, you're already most of the way there.

Position Details

Organization: Alignerr

Type: Hourly Contract

Location: Remote

Commitment: 10–40 hours/week

What You'll Do

Evaluate search engine results for relevance, accuracy, and overall usefulness to real users

Rate AI-generated answers and recommendations using structured evaluation rubrics

Compare multiple results and rank them by quality and helpfulness

Provide clear, concise written explanations to support your ratings

Work through task-based assignments independently, at your own pace and on your own schedule

Who You Are

Comfortable using search engines and navigating the web with confidence

Able to assess content relevance and quality objectively and consistentlyDetail-oriented with a methodical, systematic approach to evaluating information

Strong written communication skills in English

Self-motivated and reliable when working independently

No prior AI, tech, or search experience required

Nice to Have

Background in research, journalism, writing, editing, or information science

Experience with quality assurance, content review, or critical analysis

Broad general knowledge across a wide range of topics

Familiarity with AI tools or search platforms as an end user

Why Join Us

Work on cutting-edge AI projects alongside leading research labs

Fully remote and flexible — work when and where it suits you

Freelance autonomy with the structure of meaningful, task-based work

Make a direct impact on how AI delivers information to people around the world

Potential for ongoing work and contract extension as new projects launch

#J-18808-Ljbffr