Mediabistro logo
job logo

Remote Audio QA & Rubric Evaluator

AuraOne · New York, NY, USA · Remote ·

Pay:
27.552 - 55.104
Job type:
Contract

AuraOne is seeking a Noisy Audio Conversation Evaluator for a remote contractor role. You will review audio annotation outputs against a versioned rubric, label edge cases, and provide structured feedback to help retrain models.
This position emphasizes careful reasoning, consistency across multi-page rubrics, and asynchronous availability. Responsibilities include evaluating model outputs, selecting stronger responses with justification, tagging for policy categories, and documenting recurring

#J-18808-Ljbffr