Audio Evaluation Expert - Fully Remote Job at Mercor in Germany

Base Pay Range

$25.00/hr - $40.00/hr

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Transcribing/Writing Expert
Type: Freelance
Compensation: $25–$40/hour
Location: On-site (San Francisco)
Duration: 2–4 weeks
Commitment: 20 hours/week

Role Responsibilities

• Transcribe and optimize audio/video by creating detailed audio transcriptions with multiple constraints and instructions.
• Define and document evaluation standards by establishing high-level expectations for correct responses in general audio consumer contexts and developing a comprehensive rubric.
• Conduct model testing and grading by running prompts through models and assessing preliminary outputs against expectations.
• Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
• Work independently and meet deadlines while contributing to a structured project environment with clear goals and tools.

Qualifications

Must‑Have

• BS or BA from a reputable institution completed or in progress.
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Available to work from office 20 hours a week on the client’s location.

Preferred

• College students/grads.

Application Process (Takes 20–30 mins to complete)

• Complete an AI‑led interview, this should take around 15 minutes.
• If selected, you will be invited to work on the project.

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Referrals increase your chances of interviewing at Mercor by 2x.