Mediabistro logo
job logo

Lead Machine Learning Inference Engineer, Advertising Job at Segment (Twilio) in

Segment (Twilio) · San Jose, CA, USA ·

Pay:
$246,500-$486,100/yr
Job type:
Full Time

About the Company

Roku is the leading TV streaming platform in the U.S., Canada, and Mexico, focused on powering every television in the world. It connects consumers to content, publishers to large audiences, and advertisers to unique engagement capabilities.

About the Team

The Advertising Performance group focuses on performance for all participants in the advertising ecosystem—advertisers, publishers, and Roku. The team builds systems and solutions that perform real‑time multi‑objective optimization across large‑scale, low‑latency distributed systems. It leverages machine learning, reinforcement learning, AI, control and optimization systems, and auction dynamics, with an emphasis on the Machine Learning and Inference Platform that powers the entire landscape.

About the Role

In this role you will architect, design, and lead the development of a state‑of‑the‑art inference platform that can handle advertising‑level low latencies, scale, throughput, and availability, with optimizations that span across hardware, software, and models. We’re looking for a strong technical leader with deep experience in ML serving, high‑performance computing, and industry‑standard frameworks—someone excited to mentor engineers, innovate at scale, and shape the future of machine learning at Roku.

Responsibilities

  • Lead the design and development of a state‑of‑the‑art inference platform.
  • Oversee the development of monitoring, observability, and other tooling to ensure system and model performance, reliability, and scalability of online inference services.
  • Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end‑to‑end performance.
  • Stay at the forefront of advancements in inference frameworks, ML hardware acceleration, and distributed systems, and incorporate innovations where and when they are impactful.

Qualifications

  • M.S. or above in Computer Science, Electrical & Computer Engineering, or a related field.
  • 10+ years of experience in developing and deploying large‑scale, distributed systems, with at least 5 years in a leadership or technical lead role.
  • Strong programming skills in high‑performance languages.
  • Deep understanding of inference frameworks and ML system deployment.
  • Proven experience optimizing performance for large‑scale machine learning systems, including a deep knowledge of state‑of‑the‑art model optimizations, hardware‑software co‑design, GPU acceleration, and high‑performance computing techniques.
  • Excellent communication and collaboration skills.
  • Experience leading teams working on high‑throughput, low‑latency ML serving systems.
  • Experience collaborating with and leading global, cross‑functional teams.
  • Contributions to open‑source ML or systems projects.

Compensation and Benefits

California only – estimated annual salary range: $246,500 – $486,100. Compensation packages are based on factors unique to each candidate, including skill set, certifications, and specific geographical location.

Benefits include health insurance, equity awards, life insurance, disability benefits, parental leave, wellness benefits, and paid time off. Roku also offers global access to mental‑health and financial‑wellness support and resources, statutory and voluntary benefits such as healthcare (medical, dental, vision), life, accident, disability, commuter, and retirement options (401(k) / pension).

Hybrid Work Arrangements

Roku fosters collaboration where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose roles or office location require full‑time attendance.

Accommodations

Roku welcomes applicants of all backgrounds and provides reasonable accommodations and adjustments in accordance with applicable law. If you require reasonable accommodation at any point in the hiring process, please direct your inquiries to

Learn more about Roku at

#J-18808-Ljbffr