Mediabistro logo
job logo

Creative Writing Generative AI Analyst - California

Welocalize · New York, NY, USA ·

Pay:
$38/hour
Job type:
Full Time

Creative Writing Generative AI Analyst

We are hiring Creative Writing Generative AI Analysts in the United States to perform annotation efforts of multimedia and language data labeling and review work (e.g., video, images, and related metadata). This role focuses on annotation, data quality, prompt evaluation, and the creation of high-quality datasets used to train and improve generative AI models.
Project Details

Job Title: Creative Writing Generative AI Analyst
Location: Remote with the option to work onsite in Santa Clara, CA area.
Hours: 40 hours per week
Employment Type: W2 Full-Time Employee
Pay Rate: $38/hour
What You'll Do
Perform annotation and labeling tasks for generative AI datasets, including text, image, video, and multimodal content
Create, review, and evaluate prompts and responses across a variety of domains and use cases
Conduct quality assurance reviews to ensure annotation accuracy, consistency, and adherence to guidelines
Assist in developing and refining annotation guidelines and evaluation criteria
Support data collection, categorization, tagging, and evaluation workflows for machine learning systems
Identify edge cases, inconsistencies, and quality issues within datasets and model outputs
Collaborate with internal teams and external partners to improve annotation quality and operational efficiency
Provide feedback on workflows, tooling, and annotation processes
Requirements:
Native level proficiency English with excellent written and verbal communication skills.
Work Authorization is required for the role.
Strong attention to detail and ability to follow complex annotation guidelines
Interest in creative writing, generative AI, machine learning, and emerging AI technologies
Experience with data annotation, content evaluation, labeling operations, or quality review workflows preferred
Bachelor's degree or equivalent practical experience
Ways to Stand Out from the Crowd
Familiarity with generative AI systems, large language models, RLHF, or multimodal AI workflows
Domain knowledge in Law/Medical/Math/Coding/etc is a plus
Bilingual proficiency is a plus (Korean, Japanese, Mandarin, Spanish, German, or French)
Experience annotating prompts, responses, images, video sequences, or other AI training data
QA/testing experience within AI, data operations, or content review environments
Experience working with evaluation rubrics, taxonomy development, or dataset quality initiatives
Python or scripting experience is a plus
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.