Type: Hourly contract
Compensation: $60-$90 per hour
Commitment: 10-40 hrs/week
Role Responsibilities
- Establish evaluation standards by defining precise criteria for determining when a performance has been successfully captured in terms of emotional resonance and physical fidelity.
- Critique existing evaluation rubrics and identify gaps in the assessment of current model outputs.
- Curate benchmarks by identifying and defining prime examples of excellent or hard-to-capture performances for model testing.
- Shape the evaluation pool by defining the rater profile, expertise mix, and rubric needed to evaluate model outputs at scale.
- Collaborate with other subject matter experts to ensure consistency and accuracy in evaluation data.
Requirements
- Have strong relevant experience in the entertainment or animation industry, with at least of professional experience at recognized studios, productions, or institutions.
- Have a proven track record on 2 or more professional films, animated features, or major theater productions.
- Specialize in at least one area: Character Animation, Character Technical Design, Acting Teacher or Coach, or Director of Photography.
- Possess a meticulous eye for micro-expressions, emotional beats, and the subtleties that make a human performance feel authentic.
- Have strong written communication skills and the ability to articulate creative and craft-based judgments clearly.