Machine Learning Engineer, Alexa AI Job at Amazon in San Francisco

Job ID: 10381642 | Amazon.com Services LLC

The Alexa AI team is looking for a passionate, talented, and inventive Machine Learning Engineer with a strong machine learning background, to build capabilities such as fine tuning, distillation, and LLM inference. As an ML engineer with the Alexa AI team, you will be responsible for machine learning platform focus on LLM training, production deployment, and optimizations to advance the state of LLMs. You will collaborate closely with Applied Scientists and other MLEs, leveraging Amazon’s heterogeneous data sources and large-scale computing resources to accelerate development of Generative Artificial Intelligence solutions.

Key Responsibilities

• Investigate design approaches, prototype new technology and evaluate technical feasibility with other team engineers.


• Process data and scale machine learning models closely with Applied scientists.


• Work in an Agile/Scrum environment to deliver high quality software.

Basic Qualifications

• 3+ years of non‑internship professional software development experience


• 2+ years of non‑internship design or architecture experience (design patterns, reliability and scaling) of new and existing systems


• Experience working with PyTorch or JAX software


• Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Preferred Qualifications

• Experience with PyTorch or JAX software, or experience with vLLM, SGLang, TensorRT or similar platforms in production environments


• Experience developing large model hosting platforms, establishing frameworks, and scaling and optimizing inference systems


• Experience developing and maintaining MLOps tools in large organizations

About the Team

Central Analytics and Research Science (CARS) is an analytics, software, and science team within Amazon's Alexa AI organization. Our mission is to provide scalable and reliable evaluation of the state‑of‑the‑art Conversational AI on how customers perceive the assistants they interact with – from the metrics themselves to software applications to deep dive on those metrics – allowing assistant developers to improve their services.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Location: USA, MA, Boston