Generative AI is changing the way organizations interact
with information, automate knowledge-intensive work, build intelligent
applications, and support business decision-making. However, moving from a
general-purpose AI model to a reliable enterprise solution requires more than
simply writing a prompt.
The Solving Business Problems using SAP's Generative AI Hub
learning journey is designed to help learners understand how Large Language
Models (LLMs) can be applied within the SAP ecosystem to address practical
business requirements.
The journey begins with the
fundamentals of LLMs, including how organizations can identify suitable use
cases, design effective prompts, improve model responses, and evaluate AI
applications. Learners then explore SAP's
generative AI hub, including its architecture, model-access
capabilities, prompt tooling, and Orchestration Service.
From there, the learning
becomes increasingly practical. Participants learn how to develop and refine
prompts, integrate LLM capabilities into SAP applications using the SAP Cloud SDK for AI, compare different
models, and evaluate AI responses for business scenarios.
The final stage introduces Document Grounding and Retrieval Augmented
Generation (RAG). Learners explore how enterprise information can be
transformed into a vector knowledge base and retrieved at runtime so that AI
responses are grounded in relevant organizational data rather than relying only
on a model's general training knowledge.
By completing the journey,
participants can develop the knowledge required to move from experimenting with
generative AI toward designing secure,
context-aware, scalable, and business-focused AI solutions. This
aligns with the source document's objective of equipping learners to design,
implement, and optimize AI solutions that create measurable organizational
value.
After
completing Solving Business Problems
using SAP's Generative AI Hub, learners will be able to:
SAP's
current learning journey associates this content with Data Analyst, Developer, and Data Scientist roles and
with SAP AI Launchpad and SAP AI Core.
The
course is particularly suitable for:
Learners
begin by understanding SAP's approach to LLMs and how potential AI use cases
move from business requirements toward product and solution development. The
module then introduces prompt engineering, techniques for improving LLM
performance, and approaches for evaluating and testing AI applications.
The source curriculum specifically aims to help learners understand LLM fundamentals, identify enterprise use cases, apply prompt engineering, improve performance through techniques such as grounding and RAG, and evaluate LLM applications using industry practices.
After completing this module, you will be able to:
This
unit introduces how LLMs fit within SAP's broader AI strategy and helps
learners understand their capabilities and limitations.
Participants
explore why enterprise AI differs from general-purpose consumer AI. Business
applications require context, security, governance, appropriate model
selection, trusted information, and integration with real business processes.
Learners
begin developing the ability to evaluate whether an LLM is appropriate for a
particular business problem instead of assuming generative AI is automatically
the right solution for every scenario.
This
unit explores the thinking behind developing LLM-based use cases and helps
learners understand how business requirements, user needs, AI capabilities,
technical feasibility, quality, and risk influence solution development.
Participants
learn to think beyond the initial AI demonstration and consider what is
required to turn an LLM use case into something people can reliably use within
an enterprise environment.
The
unit encourages a business-problem-first
approach: identify the problem, understand the expected outcome,
determine where generative AI adds value, and then design the appropriate
solution.
This
unit introduces prompt engineering
as a practical skill for designing more useful AI interactions.
Learners
explore how prompts can clearly communicate the task, provide relevant context,
define expected output, introduce constraints, and guide the model toward more
appropriate responses.
Rather
than relying on trial and error, participants begin developing a systematic
approach to prompt design.
This
becomes especially important when prompts need to be reused across business
applications rather than written manually for every interaction.
This
unit introduces additional techniques that can improve the relevance and
reliability of LLM outputs.
Learners
explore concepts such as grounding and Retrieval Augmented Generation, where
information relevant to a user's request is retrieved and provided to the model
as additional context.
SAP
currently describes grounding as connecting generative AI models with external,
domain-specific, or current information so that responses can become more
relevant to a particular business scenario.
The unit helps learners understand an important distinction between asking a model to answer from its general knowledge and enabling it to answer using information relevant to the organization.
Enterprise AI solutions therefore need systematic evaluation.
This unit helps learners understand how LLM applications can be tested against business requirements and quality expectations.
Participants explore the importance of evaluating factors such as:
Participants
explore the architecture and capabilities of SAP's generative AI hub, including model access and
management, prompt-related functionality, and the Orchestration Service.
The
uploaded curriculum specifically identifies understanding the hub's
architecture, accessing and managing multiple LLMs, using prompt engineering
and model management capabilities, and leveraging orchestration for secure
enterprise AI applications as key outcomes.
SAP's current introductory course also covers integration with SAP AI Core and SAP AI Launchpad, access to multiple models, Model Library, Chat, Prompt Editor, and the Orchestration Service.
After completing this module, you will be able to:
SAP's
generative AI hub provides a managed environment for accessing and working with
generative AI models within SAP's enterprise AI ecosystem.
This
unit helps learners understand its architecture and core capabilities.
Participants
explore how the hub can support model discovery, model access, prompt
experimentation, prompt management, and AI application development while
maintaining enterprise requirements around governance and security.
Current
SAP Learning material identifies interfaces such as Model Library, Chat, Prompt Editor, and Orchestration Service
as part of this environment.
A
workflow may need to prepare the prompt, select a model, retrieve business
context, protect sensitive information, apply safety controls, and process the
resulting response.
The
Orchestration Service helps
bring these activities together into structured AI workflows.
Learners
explore how orchestration can help developers build more controlled and
reusable generative AI solutions.
Current
SAP documentation shows that orchestration workflows can be built, tested,
saved as configurations, and executed through SAP AI Launchpad and SAP AI Core.
Learners
develop prompts for business scenarios, integrate LLMs into applications using
the SAP Cloud SDK for AI,
apply more advanced prompt engineering approaches, and compare prompts across
multiple models.
The
source curriculum identifies these four areas as the core units of the module.
SAP's current course also covers prompt templates and versions, Prompt Registry, orchestration workflows, advanced techniques such as few-shot and meta prompting, multimodal inputs, automated evaluation, and comparison of models based on factors including accuracy and cost.
Learners
explore how prompts can be developed, tested, refined, saved, and reused for
business applications.
Participants
also develop an understanding of prompt
templates, where dynamic information can be inserted into a structured
prompt without rewriting the complete instruction each time.
For
enterprise development, reusable prompts help teams maintain consistency across
applications and use cases.
Learners
also become familiar with concepts such as prompt versioning and the Prompt
Registry, helping them understand how prompts can be managed as reusable
development assets rather than temporary text entered into a chat interface.
This
unit introduces the SAP Cloud SDK for
AI and helps learners understand how generative AI capabilities can be
incorporated into application development.
Participants
explore how developers can interact with models, send requests, receive
generated responses, and integrate AI capabilities into broader application
workflows.
The
unit bridges the gap between prompt
experimentation and application development, helping learners
understand how LLM functionality becomes part of a real enterprise solution.
This
unit develops more advanced prompt engineering skills and helps learners
systematically refine model responses.
SAP's
current course specifically identifies techniques including few-shot prompting and meta prompting.
Learners
explore how examples, instructions, context, formatting requirements, and
prompt structure can influence the model's output.
The
emphasis is on controlled experimentation: adjust the prompt, evaluate the
result, identify weaknesses, and refine the instruction until the response
better satisfies the business requirement.
This
unit helps learners compare model behavior rather than assuming a single model
is ideal for every use case.
Participants
explore how prompts can be tested against multiple models and how results can
be evaluated according to factors such as response quality, accuracy,
consistency, latency, and cost.
SAP's
current course specifically includes comparing models for accuracy and cost and automating
prompt evaluation.
The objective is to help learners make more informed model-selection decisions based on the actual requirements of a business scenario.
General-purpose
LLMs are trained on broad datasets. They do not automatically know an
organization's private documents, current policies, internal procedures,
product documentation, or other proprietary information.
Document
grounding helps address this limitation.
Learners
explore how documents can be converted into searchable vector representations,
how relevant information can be retrieved according to a user's request, and
how that information can be supplied to the LLM as context.
This
forms the foundation of Retrieval
Augmented Generation (RAG).
The source curriculum specifically covers document grounding, vector knowledge bases, configuration of the Document Grounding module in the Orchestration Service, RAG, and reliable enterprise AI solutions.
Learners
explore how organizational information can be prepared as a vector knowledge base and made
available for semantic retrieval.
SAP's
current Document Grounding implementation follows a RAG approach and uses
vector representations to retrieve relevant document information that can be
supplied as context to an LLM.
A
simplified flow looks like:
Enterprise Documents → Content
Processing → Embeddings → Vector Knowledge Base → Semantic Retrieval → Relevant
Context → LLM → Grounded Response
SAP's
current documentation explains that document pipelines can fetch information,
divide content into chunks, generate semantic embeddings, and store those
representations for later retrieval.
This
allows the application to retrieve information relevant to a user's question
rather than passing an entire document repository to the LLM.
The result can be AI responses that are more closely connected to trusted organizational knowledge.
The
uploaded curriculum includes a practice environment where learners can complete
hands-on exercises involving prompt
development, template management, and workflow orchestration within SAP AI
Launchpad.
SAP's current learning material confirms that this practice environment provides access to a preconfigured SAP AI Launchpad system for completing course exercises.