Mediabistro logo
job logo

Remote Post-Training Data Preference Evaluator

AuraOne · New York, NY, USA ·

Pay:
34.440 - 55.104
Job type:
Contract

AuraOne is seeking a Remote Post-Training Data Preference Data Reviewer to audit evaluation prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and write structured feedback the modeling team can use to retrain.
Responsibilities include evaluating model outputs, tagging issues with rubric clauses, and calibrating scores against gold standards. This CONTRACTOR role requires clear reasoning, strong attention to detail, and reliable weekly

#J-18808-Ljbffr