Mediabistro logo
job logo

Remote Retrieval Relevance Evaluator and Rubric Specialist

AuraOne · New York, NY, USA · Remote ·

Pay:
28.000 - 41.000
Job type:
Contract

AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning, attention to detail, and ability to work asynchronously for at least 10 hours per week. Experience with rubrics and annotation is ideal. You’ll help label edge cases and support rubric updates.
#J-18808-Ljbffr