Responsibilities
Create and execute role-play–based evaluation scenarios simulating realistic customer service interactions in travel, finance, and telecommunications
Contribute to the development of diverse and representative datasets for conversational audio agents
Evaluate model performance using qualitative and quantitative metrics
Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow
Requirements
Strong verbal communication skills in a simulated customer support context
English proficiency across reading, listening, writing, and speaking
Access to a high-quality microphone for clean audio input
Basic computer programming literacy, including JSON structures and familiarity with functions and methods
Ability to reason about structured data and simple logic
Device capable of running audio recording software and handling large technical documentation
About the Company
This project is dedicated to assessing and benchmarking advanced agentic audio models against leading systems to optimize performance for real-world customer support use cases.
#J-18808-Ljbffr

Agency is hiring: Agentic Audio Specialist in New York
Agency · New York, NY, USA ·
- Job type:
- Full Time