AI/ML Applied Data Scientist - Generative AI
SAP SE, Newport Beach, CA, United States
AI/ML Applied Data Scientist – Generative AI
Summary
We're hiring an experienced AI/ML Scientist to join our newly formed Foundation Model team in Newport Beach. This team sits at the forefront of SAP's cloud transformation, building specialized foundation models and AI agents that accelerate our customers' data transformation journeys. We own the full stack: continued pretraining on SAP data, fine‑tuning for domain‑specific tasks, and the agentic workflows that bring these models into SAP products.
What you’ll do
Model Development: Oversee the development, fine‑tuning, and integration of foundation models into SAP solutions to streamline cloud transformation journeys.
Build agents and agentic workflows: Design multi‑step, tool‑using agents (single‑agent and multi‑agent) that solve real SAP business problems, planning, tool calling, memory, reflection, and human‑in‑the‑loop patterns.
Evaluate rigorously: Build offline and online evaluation harnesses, task success, trajectory quality, tool‑call accuracy, groundedness, and regression testing. Turn production failures into eval cases that gate deployment.
Observe and improve: Instrument agents with tracing, session and span capture, and automated scoring. Close the loop between production signals and development (trace → eval → fix).
Collaboration: Engage with stakeholders in different teams at SAP as well as early adopter customers and research collaborations.
What you bring
Education:
BS, MS, in Computer Science, ML, Data Science, or a related field.
Experience:
3+ years of experience in data science, with at least 1 year hands‑on with LLMs and agents in production or near‑production settings.
Core technical skills:
Strong Python; solid software engineering fundamentals: testing, version control, modularity, async.
Deep learning frameworks: PyTorch (primary) and familiarity with fine‑tuning and PEFT methods (LoRA, QLoRA).
LLM application development: prompting, structured outputs, function and tool calling, context management.
Experience with LangGraph, Langfuse, MLFlow/W&B, etc.
Nice to have:
Familiarity with continued pre‑training, fine‑tuning pipelines (SFT, DPO, RLHF), or inference optimization (vLLM, TensorRT‑LLM, quantization).
Experience running human‑in‑the‑loop annotation workflows.
Meet your team
The Foundation Model team is pioneering AI innovations within SAP, as part of the Generative AI foundation within Business AI at SAP. We build and refine our own domain‑specialized foundation models on SAP business data through continued pre‑training and fine‑tuning, and we build the agentic layer that brings these models into SAP products. By joining our team, you’ll help shape the future of AI at SAP and drive meaningful advances in how enterprise software gets transformed.
Compensation
SAP provides an annualized compensation range inclusive of base salary and variable incentive target. The targeted annual combined range for this position is 90,000–198,500 USD. The actual amount offered will be within that range, depending on education, skills, experience, scope of the role, location, and other factors. Any SAP variable incentive includes a targeted dollar amount and any actual payout is dependent on company and personal performance. Please reference the summary of SAP benefits and eligibility requirements: SAP North America Benefits.
Equal Employment Opportunity
Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, etc.), sexual orientation, gender identity or expression, protected veteran status, or disability.
Requisition ID: 451907 | Work Area: Software‑Design and Development | Expected Travel: 0 – 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid
#J-18808-Ljbffr
Summary
We're hiring an experienced AI/ML Scientist to join our newly formed Foundation Model team in Newport Beach. This team sits at the forefront of SAP's cloud transformation, building specialized foundation models and AI agents that accelerate our customers' data transformation journeys. We own the full stack: continued pretraining on SAP data, fine‑tuning for domain‑specific tasks, and the agentic workflows that bring these models into SAP products.
What you’ll do
Model Development: Oversee the development, fine‑tuning, and integration of foundation models into SAP solutions to streamline cloud transformation journeys.
Build agents and agentic workflows: Design multi‑step, tool‑using agents (single‑agent and multi‑agent) that solve real SAP business problems, planning, tool calling, memory, reflection, and human‑in‑the‑loop patterns.
Evaluate rigorously: Build offline and online evaluation harnesses, task success, trajectory quality, tool‑call accuracy, groundedness, and regression testing. Turn production failures into eval cases that gate deployment.
Observe and improve: Instrument agents with tracing, session and span capture, and automated scoring. Close the loop between production signals and development (trace → eval → fix).
Collaboration: Engage with stakeholders in different teams at SAP as well as early adopter customers and research collaborations.
What you bring
Education:
BS, MS, in Computer Science, ML, Data Science, or a related field.
Experience:
3+ years of experience in data science, with at least 1 year hands‑on with LLMs and agents in production or near‑production settings.
Core technical skills:
Strong Python; solid software engineering fundamentals: testing, version control, modularity, async.
Deep learning frameworks: PyTorch (primary) and familiarity with fine‑tuning and PEFT methods (LoRA, QLoRA).
LLM application development: prompting, structured outputs, function and tool calling, context management.
Experience with LangGraph, Langfuse, MLFlow/W&B, etc.
Nice to have:
Familiarity with continued pre‑training, fine‑tuning pipelines (SFT, DPO, RLHF), or inference optimization (vLLM, TensorRT‑LLM, quantization).
Experience running human‑in‑the‑loop annotation workflows.
Meet your team
The Foundation Model team is pioneering AI innovations within SAP, as part of the Generative AI foundation within Business AI at SAP. We build and refine our own domain‑specialized foundation models on SAP business data through continued pre‑training and fine‑tuning, and we build the agentic layer that brings these models into SAP products. By joining our team, you’ll help shape the future of AI at SAP and drive meaningful advances in how enterprise software gets transformed.
Compensation
SAP provides an annualized compensation range inclusive of base salary and variable incentive target. The targeted annual combined range for this position is 90,000–198,500 USD. The actual amount offered will be within that range, depending on education, skills, experience, scope of the role, location, and other factors. Any SAP variable incentive includes a targeted dollar amount and any actual payout is dependent on company and personal performance. Please reference the summary of SAP benefits and eligibility requirements: SAP North America Benefits.
Equal Employment Opportunity
Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, etc.), sexual orientation, gender identity or expression, protected veteran status, or disability.
Requisition ID: 451907 | Work Area: Software‑Design and Development | Expected Travel: 0 – 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid
#J-18808-Ljbffr