Mercor is hiring: Audio Evaluator - Fully Remote in New York
Mercor, New York, NY, United States
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Transcribing/Writing Expert
Type: Contract
Compensation: $25–$50/hour
Duration: ~6 months
Commitment: 20 hours/week
Role Responsibilities
Transcribe and optimize audio/video content from Romanian, ensuring detailed accuracy under multiple constraints.
Define and document evaluation standards, establishing expectations for correct responses in general audio consumer contexts.
Conduct model testing and grading by running prompts through models and assessing outputs against expectations.
Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor.
Qualifications
Must-Have
BS or BA from a reputable institution completed or in progress
Strong writing and critical thinking skills.
Preferred
College students/grads
Application Process (Takes 20–30 mins to complete)
Complete an AI-led interview, this should take around 15 minutes.
If selected, you will be invited to work on the project.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Transcribing/Writing Expert
Type: Contract
Compensation: $25–$50/hour
Duration: ~6 months
Commitment: 20 hours/week
Role Responsibilities
Transcribe and optimize audio/video content from Romanian, ensuring detailed accuracy under multiple constraints.
Define and document evaluation standards, establishing expectations for correct responses in general audio consumer contexts.
Conduct model testing and grading by running prompts through models and assessing outputs against expectations.
Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor.
Qualifications
Must-Have
BS or BA from a reputable institution completed or in progress
Strong writing and critical thinking skills.
Preferred
College students/grads
Application Process (Takes 20–30 mins to complete)
Complete an AI-led interview, this should take around 15 minutes.
If selected, you will be invited to work on the project.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr