Mediabistro logo
job logo

LLM Benchmark Engineer — Lead Leaderboard Insights

Vals AI, Inc. · San Francisco, CA, USA ·

Pay:
150.000 - 190.000
Job type:
Full Time

Vals AI, Inc. in San Francisco is seeking strong engineers to own the leaderboards that evaluate real-world tasks by LLMs.
You will test and benchmark new models across domains like law, tax, coding, finance and more, analyzing error modes and collaborating with the communications team to publish results. The role involves working with major labs and institutions, building model library integrations, and maintaining benchmarks infrastructure in a fast, sprint-driven environment.

#J-18808-Ljbffr