LLM Optimization & Evaluation
Austin, TX
Job Summary We are seeking a highly skilled
LLM Optimization & Evaluation Specialist
to design, optimize, and evaluate large language model (LLM) systems in production. This role focuses on
prompt optimization, RAG tuning, inference efficiency, and modern evaluation frameworks
to ensure high-quality, scalable, and cost-effective GenAI solutions. The ideal candidate has hands-on experience with
LLM-as-a-Judge evaluators, RAG pipelines, observability, and enterprise-grade GenAI systems .
Job Summary We are seeking a highly skilled
LLM Optimization & Evaluation Specialist
to design, optimize, and evaluate large language model (LLM) systems in production. This role focuses on
prompt optimization, RAG tuning, inference efficiency, and modern evaluation frameworks
to ensure high-quality, scalable, and cost-effective GenAI solutions. The ideal candidate has hands-on experience with
LLM-as-a-Judge evaluators, RAG pipelines, observability, and enterprise-grade GenAI systems .