Principal ML Engineer – AI & LLM Infrastructure Job at SAP SE in New Bremen
SAP SE, New Bremen, OH, United States
Principal Machine Learning (Senior/ Expert)/ Development (Senior/ Expert) (f/m/d) We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.
What you’ll do
We are seeking a highly skilled and driven Principal Machine Learning Engineer (f/m/d) to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production—driving meaningful impact across SAP’s global ecosystem.
As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM-based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives.
Key Responsibilities:
· Architect, design, and implement production systems in Go, Java and Python (full-stack experience a plus)
· Build and optimize backend services, databases, APIs, and LLM infrastructure
· Leverage technologies such as Kafka, Postgres, Hana, gRPC, and advanced LLM frameworks
· Mentor and guide engineers from junior to senior levels, fostering technical excellence
· Partner with cross-functional teams to translate business goals into scalable, high-impact solutions
What you bring
· Bachelor’s degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise
· 10+ years of software engineering experience, with a track record of delivering complex systems
· Proven ability to work independently and lead initiatives from idea to deployment
· Hands-on experience with AI/ML and/or LLM systems in a production environment
· Expertise in distributed systems design and implementation
· Familiarity with CI/CD pipelines and modern development practices
· Strong English communication skills and ability to thrive in global, multicultural teams
Preferred Qualifications:
· Open-source contributions or significant personal technical projects
· Experience integrating AI capabilities into large-scale enterprise products
· Strong problem-solving skills and an iterative, results-oriented mindset
#LI-JK6
Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.
We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.
Please note that any violation of these guidelines may result in disqualification from the hiring process.
Requisition ID: 446273 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid
#J-18808-Ljbffr
In Summary: We are seeking a highly skilled and driven Principal Machine Learning Engineer (f/m/d) to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities . We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges .
En Español: Principal Machine Learning (Senior/Experto) / Desarrollo (senior/expert) (f/m/d) Ayudamos al mundo a funcionar mejor En SAP, lo mantenemos simple: usted nos trae el mejor de sí mismo y sacaremos lo mejor de ti. Somos constructores que tocan más de 20 industrias y 80% del comercio global, y necesitamos tus talentos únicos para ayudar a dar forma a lo que viene. El trabajo es desafiante pero importa. Encontrarás un lugar donde puedas ser tú mismo, priorizar tu bienestar y pertenecer verdaderamente. ¿Qué te sirve? Aprendizaje constante, crecimiento de habilidades, grandes desafíos y un equipo que quiera que crezcas y triunfas. Lo que vas a hacer Estamos buscando un ingeniero principal de maquinaria altamente calificado (F/M/D) para abordar los sistemas generales y distribuidos en una amplia escala. Trabajará a través de una gama diversa de tecnologías, colaborará estrechamente con ingenieros y líderes de productos y ayudará a establecer la dirección técnica para las iniciativas de IA. Responsabilidades clave: · Arquitecto, diseño e implementación de sistemas de producción en Go, Java y Python (experiencia completa más) · Construir y optimizar servicios backend, bases de datos, APIs y infraestructuras LLM · Aprovechar tecnologías como Kafka, Postgres, Hana, gRPC y marcos avanzados de LLM • Mentor y guía de ingenieros desde niveles junior hasta superiores, fomentando la excelencia técnica · Socio con equipos interfuncionales para traducir los objetivos empresariales en soluciones escalables y de alto impacto Lo que usted trae · Licenciatura en Informática, Matemáticas, Física o prácticas de campo, con una sólida experiencia especializada · 10 años de experiencia profesional en software con un conjunto de cuatro proyectos de desarrollo de sistemas informáticos de código abierto + Experiencias profesionales / Capacitación para desarrollar y implementar mejor sus capacidades tecnológicas en el mundo entero · Desarrollar eficientemente mejores competencias en tecnología de gestión de problemas relacionados con la creación de programas de conocimientos personales con una gran capacidad de trabajo ... Originalmente conocida por su liderazgo en el software de planificación de recursos empresariales (ERP), SAP ha evolucionado para convertirse en un líder del mercado en software de aplicaciones comerciales de extremo a extremo y servicios relacionados con bases de datos, análisis, tecnologías inteligentes y gestión de la experiencia. Como una empresa en nube con doscientos millones de usuarios y más de cien mil empleados en todo el mundo, somos orientadas al propósito y enfocadas hacia el futuro, con una ética de equipo altamente colaborativa y compromiso con el desarrollo personal. Ya sea conectando industrias globales, personas o plataformas, ayudamos a garantizar que cada desafío obtenga la solución que merece. En SAP, puedes sacar tu mejor partido. Ganamos con inclusión La cultura de inclusión mental de SAP, centrarte en salud y bienestar, y los modelos de trabajo flexibles ayudan a asegurar que todos se sientan incluidos e puedan ejecutar a sus mejores niveles. Si está interesado en solicitar un empleo con SAP y necesita alojamiento o asistencia especial para navegar por nuestro sitio web o completar su solicitud, envíe un correo electrónico con su petición a la Equipo de Operaciones de Reclutamiento: Careers@sap.com. Para los empleados de SAP: Solo los roles permanentes son elegibles para el Programa de Referencia de Empleado de SAP , según las reglas de elegibilidad establecidas en la Política de Referencias de SAP .
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.
What you’ll do
We are seeking a highly skilled and driven Principal Machine Learning Engineer (f/m/d) to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production—driving meaningful impact across SAP’s global ecosystem.
As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM-based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives.
Key Responsibilities:
· Architect, design, and implement production systems in Go, Java and Python (full-stack experience a plus)
· Build and optimize backend services, databases, APIs, and LLM infrastructure
· Leverage technologies such as Kafka, Postgres, Hana, gRPC, and advanced LLM frameworks
· Mentor and guide engineers from junior to senior levels, fostering technical excellence
· Partner with cross-functional teams to translate business goals into scalable, high-impact solutions
What you bring
· Bachelor’s degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise
· 10+ years of software engineering experience, with a track record of delivering complex systems
· Proven ability to work independently and lead initiatives from idea to deployment
· Hands-on experience with AI/ML and/or LLM systems in a production environment
· Expertise in distributed systems design and implementation
· Familiarity with CI/CD pipelines and modern development practices
· Strong English communication skills and ability to thrive in global, multicultural teams
Preferred Qualifications:
· Open-source contributions or significant personal technical projects
· Experience integrating AI capabilities into large-scale enterprise products
· Strong problem-solving skills and an iterative, results-oriented mindset
#LI-JK6
Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.
We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.
Please note that any violation of these guidelines may result in disqualification from the hiring process.
Requisition ID: 446273 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid
#J-18808-Ljbffr
In Summary: We are seeking a highly skilled and driven Principal Machine Learning Engineer (f/m/d) to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities . We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges .
En Español: Principal Machine Learning (Senior/Experto) / Desarrollo (senior/expert) (f/m/d) Ayudamos al mundo a funcionar mejor En SAP, lo mantenemos simple: usted nos trae el mejor de sí mismo y sacaremos lo mejor de ti. Somos constructores que tocan más de 20 industrias y 80% del comercio global, y necesitamos tus talentos únicos para ayudar a dar forma a lo que viene. El trabajo es desafiante pero importa. Encontrarás un lugar donde puedas ser tú mismo, priorizar tu bienestar y pertenecer verdaderamente. ¿Qué te sirve? Aprendizaje constante, crecimiento de habilidades, grandes desafíos y un equipo que quiera que crezcas y triunfas. Lo que vas a hacer Estamos buscando un ingeniero principal de maquinaria altamente calificado (F/M/D) para abordar los sistemas generales y distribuidos en una amplia escala. Trabajará a través de una gama diversa de tecnologías, colaborará estrechamente con ingenieros y líderes de productos y ayudará a establecer la dirección técnica para las iniciativas de IA. Responsabilidades clave: · Arquitecto, diseño e implementación de sistemas de producción en Go, Java y Python (experiencia completa más) · Construir y optimizar servicios backend, bases de datos, APIs y infraestructuras LLM · Aprovechar tecnologías como Kafka, Postgres, Hana, gRPC y marcos avanzados de LLM • Mentor y guía de ingenieros desde niveles junior hasta superiores, fomentando la excelencia técnica · Socio con equipos interfuncionales para traducir los objetivos empresariales en soluciones escalables y de alto impacto Lo que usted trae · Licenciatura en Informática, Matemáticas, Física o prácticas de campo, con una sólida experiencia especializada · 10 años de experiencia profesional en software con un conjunto de cuatro proyectos de desarrollo de sistemas informáticos de código abierto + Experiencias profesionales / Capacitación para desarrollar y implementar mejor sus capacidades tecnológicas en el mundo entero · Desarrollar eficientemente mejores competencias en tecnología de gestión de problemas relacionados con la creación de programas de conocimientos personales con una gran capacidad de trabajo ... Originalmente conocida por su liderazgo en el software de planificación de recursos empresariales (ERP), SAP ha evolucionado para convertirse en un líder del mercado en software de aplicaciones comerciales de extremo a extremo y servicios relacionados con bases de datos, análisis, tecnologías inteligentes y gestión de la experiencia. Como una empresa en nube con doscientos millones de usuarios y más de cien mil empleados en todo el mundo, somos orientadas al propósito y enfocadas hacia el futuro, con una ética de equipo altamente colaborativa y compromiso con el desarrollo personal. Ya sea conectando industrias globales, personas o plataformas, ayudamos a garantizar que cada desafío obtenga la solución que merece. En SAP, puedes sacar tu mejor partido. Ganamos con inclusión La cultura de inclusión mental de SAP, centrarte en salud y bienestar, y los modelos de trabajo flexibles ayudan a asegurar que todos se sientan incluidos e puedan ejecutar a sus mejores niveles. Si está interesado en solicitar un empleo con SAP y necesita alojamiento o asistencia especial para navegar por nuestro sitio web o completar su solicitud, envíe un correo electrónico con su petición a la Equipo de Operaciones de Reclutamiento: Careers@sap.com. Para los empleados de SAP: Solo los roles permanentes son elegibles para el Programa de Referencia de Empleado de SAP , según las reglas de elegibilidad establecidas en la Política de Referencias de SAP .