Principal Machine Learning Engineer Job at ChatGPT Jobs in boston

Job Description

Company: Redhat
Location: Boston, MA
On-site, Remote
Salary: $189.60K - $312.73K/yr
Type: Full-time
Benefits: Medical, Dental, Vision, Retirement, PTO

Job Summary

Red Hat is seeking a Principal Machine Learning Engineer to join our AI Inference team, focused on bringing open-source LLMs and vLLM to enterprises. The role involves developing and optimizing deep learning software, implementing model compression algorithms, and productizing deep learning research.

What You Will Do

• Contribute to the design, development, and testing of various inference optimization algorithms in vLLM and related projects.
• Create and manage inference serving deployment pipelines.
• Benchmark, profile, and evaluate different parallelizations, quantization and sparsification approaches.
• Participate in technical design discussions and provide innovative solutions.
• Stay up-to-date with the latest advancements in open source LLM model architecture and inference parallelizations/optimizations techniques.
• Stay up-to-date of latest CPU and GPU hardware architecture and features to boost AI inference performance.
• Give thoughtful and prompt code reviews.
• Mentor and guide other engineers.
• Continuous collaboration with internal and external open source committers and contributors.

What You Will Bring

• Strong understanding of machine learning and deep learning fundamentals.
• Experience with tensor math libraries such as PyTorch and NumPy.
• Strong programming skills with Python based machine learning solutions.
• Ability to develop and implement research ideas and algorithms.
• Experience with mathematical software, especially linear algebra.
• Understanding of Linear Algebra, Gradients, Probability, and Graph Theory.
• Strong communications skills with both technical and non-technical team members.
• BS, or MS in computer science or computer engineering or a related field. A PhD in a ML related domain is considered a strong plus.

Pay Transparency

Red Hat determines compensation based on factors including job location, experience, skills, training, market value, and internal pay equity. The salary range for this position is $189,600.00 - $312,730.00.

#J-18808-Ljbffr