Course description

Generative AI is changing the way organizations interact with information, automate knowledge-intensive work, build intelligent applications, and support business decision-making. However, moving from a general-purpose AI model to a reliable enterprise solution requires more than simply writing a prompt.

The Solving Business Problems using SAP's Generative AI Hub learning journey is designed to help learners understand how Large Language Models (LLMs) can be applied within the SAP ecosystem to address practical business requirements.

The journey begins with the fundamentals of LLMs, including how organizations can identify suitable use cases, design effective prompts, improve model responses, and evaluate AI applications. Learners then explore SAP's generative AI hub, including its architecture, model-access capabilities, prompt tooling, and Orchestration Service.

From there, the learning becomes increasingly practical. Participants learn how to develop and refine prompts, integrate LLM capabilities into SAP applications using the SAP Cloud SDK for AI, compare different models, and evaluate AI responses for business scenarios.

The final stage introduces Document Grounding and Retrieval Augmented Generation (RAG). Learners explore how enterprise information can be transformed into a vector knowledge base and retrieved at runtime so that AI responses are grounded in relevant organizational data rather than relying only on a model's general training knowledge.

By completing the journey, participants can develop the knowledge required to move from experimenting with generative AI toward designing secure, context-aware, scalable, and business-focused AI solutions. This aligns with the source document's objective of equipping learners to design, implement, and optimize AI solutions that create measurable organizational value.

Key Learning Outcomes

After completing Solving Business Problems using SAP's Generative AI Hub, learners will be able to:

  • Explain the fundamentals of Large Language Models.
  • Understand the strengths and limitations of LLMs.
  • Identify suitable enterprise generative AI use cases.
  • Apply prompt engineering techniques to business scenarios.
  • Develop, refine, and manage reusable prompts.
  • Work with prompt templates and prompt versions.
  • Understand Prompt Registry concepts.
  • Explain the architecture and capabilities of SAP's generative AI hub.
  • Understand model access and model-selection considerations.
  • Work with SAP's Orchestration Service concepts.
  • Understand how SAP Cloud SDK for AI supports application integration.
  • Compare responses across different LLMs.
  • Evaluate prompts and models against business requirements.
  • Understand grounding and Retrieval Augmented Generation.
  • Explain vector embeddings and semantic retrieval.
  • Create and manage the concepts behind vector knowledge bases.
  • Understand Document Grounding within the Orchestration Service.
  • Connect AI responses with trusted enterprise information.
  • Design more reliable and context-aware generative AI solutions.
  • Translate business problems into structured enterprise AI use cases.

Who Should Attend?

SAP's current learning journey associates this content with Data Analyst, Developer, and Data Scientist roles and with SAP AI Launchpad and SAP AI Core.

The course is particularly suitable for:

  • SAP AI Developers
  • SAP BTP Developers
  • SAP AI Core Developers
  • Data Scientists
  • Data Analysts
  • Generative AI Developers
  • SAP Technical Consultants
  • SAP BTP Consultants
  • AI/ML Engineers
  • Solution Architects
  • Enterprise AI Architects
  • Application Developers
  • Technical Leads
  • AI Solution Consultants
  • Professionals building enterprise generative AI solutions
  • Developers interested in LLM and RAG applications 

What will i learn?

  • Large Language Models & Enterprise Generative AI – Enterprise-grade LLM capabilities for developing secure, scalable, and context-aware generative AI applications.
  • SAP Generative AI Hub, AI Core & AI Launchpad – SAP’s AI platform capabilities for accessing, managing, deploying, and operating generative AI models and enterprise AI workloads.
  • Prompt Engineering & Prompt Management – Prompt engineering, few-shot prompting, meta prompting, reusable prompt templates, prompt management, and prompt registry capabilities.
  • Model Selection, Evaluation & AI Response Quality – Model selection, multi-model evaluation, LLM evaluation, and AI response evaluation to identify suitable models and improve output quality.
  • AI Orchestration & SAP Cloud SDK for AI – AI orchestration, orchestration services, and SAP Cloud SDK for AI to integrate models and AI capabilities into enterprise applications and workflows.
  • RAG, Grounding & Document Grounding – Retrieval-Augmented Generation (RAG), grounding, and document grounding to generate responses based on trusted enterprise information and business context.
  • Vector Embeddings, Semantic Search & Knowledge Retrieval – Vector embeddings, vector knowledge bases, semantic search, and enterprise knowledge retrieval for intelligent discovery and contextual information access.
  • Context-Aware Enterprise AI Application Development – Development of enterprise AI applications combining LLMs, organizational knowledge, orchestration, retrieval, and contextual intelligence.

Requirements

  • Basic understanding of artificial intelligence and generative AI.
  • General familiarity with Large Language Models.
  • Basic knowledge of cloud applications.
  • Familiarity with SAP BTP is helpful.
  • Basic understanding of SAP AI Core or SAP AI Launchpad is helpful.
  • Basic programming knowledge is beneficial for SAP Cloud SDK for AI topics.
  • General understanding of APIs is useful.
  • Basic knowledge of embeddings, vector databases, or RAG can help with the advanced module but is not necessary at the beginning.

Frequently asked question

It is an SAP learning journey focused on applying Large Language Models and generative AI to enterprise business problems. The curriculum covers LLM fundamentals, SAP's generative AI hub, prompt engineering, model evaluation, SAP Cloud SDK for AI, orchestration, Document Grounding, and Retrieval Augmented Generation.

SAP's generative AI hub provides capabilities for working with generative AI models within SAP's enterprise AI environment. Current SAP Learning material describes capabilities including secure access to multiple models, model selection and lifecycle management, Prompt Editor, Model Library, Chat, Prompt Registry-related functionality, and the Orchestration Service.

Yes. Prompt engineering is one of the central themes of the journey. Learners first explore prompt engineering fundamentals and later develop, refine, manage, and evaluate prompts inside SAP's generative AI environment.

Yes. Unit 4: Evaluating Prompts Using Multiple Models focuses on comparing prompts and model responses. SAP's current course also includes model comparison according to factors such as accuracy and cost, helping learners select models according to the needs of a specific business scenario.

Yes. Retrieval-Augmented Generation is an important part of the advanced module. Learners explore document grounding, vector knowledge bases, semantic retrieval, and using retrieved enterprise information as context for generative AI responses.

Document Grounding connects an AI workflow with relevant information from enterprise documents or other supported information sources. SAP's current documentation describes Document Grounding as implementing a RAG approach: relevant information is retrieved from documents and supplied as context so that the model can generate more accurate and business-specific responses.

Yes. The uploaded curriculum includes Hands-on Practice for Solving your business problems using prompts and LLMs in SAP's Generative AI Hub. The practice environment allows learners to work with prompt development, template management, and workflow orchestration in a preconfigured SAP AI Launchpad environment.

Programming knowledge is particularly useful for Unit 2: Leveraging the Power of Large Language Models Using SAP Cloud SDK for AI, where generative AI capabilities are integrated programmatically. However, several earlier parts of the journey—including LLM fundamentals, prompt engineering, generative AI hub concepts, and model evaluation—can be understood without advanced software-development experience.

The journey provides a foundation for designing enterprise generative AI solutions such as intelligent knowledge assistants, document-based Q&A applications, summarization solutions, AI-supported business workflows, contextual enterprise assistants, and other LLM-powered applications.

  • Lesson 01
    Course Description

    This module establishes the foundation required to work effectively with Large Language Models in enterprise scenarios.

    Learners begin by understanding SAP's approach to LLMs and how potential AI use cases move from business requirements toward product and solution development. The module then introduces prompt engineering, techniques for improving LLM performance, and approaches for evaluating and testing AI applications.

    The source curriculum specifically aims to help learners understand LLM fundamentals, identify enterprise use cases, apply prompt engineering, improve performance through techniques such as grounding and RAG, and evaluate LLM applications using industry practices. 

    Summary:

    What You Will Learn

    After completing this module, you will be able to:

    • Understand the fundamentals of Large Language Models.
    • Explain how LLMs can be applied to enterprise scenarios.
    • Recognize the strengths and limitations of generative AI.
    • Identify suitable business problems for LLM-based solutions.
    • Understand SAP's approach to developing LLM use cases.
    • Design more effective prompts for business scenarios.
    • Apply prompt engineering techniques.
    • Understand approaches for improving model responses.
    • Explain the role of grounding and RAG.
    • Evaluate LLM outputs systematically.
    • Recognize quality, reliability, and performance considerations when designing AI applications.
  • Lesson 02
    Unit 1: Describing SAP's Approach to Large Language Models

    Large Language Models can generate, summarize, transform, classify, and reason over natural-language information, but enterprise use requires a structured approach.

    This unit introduces how LLMs fit within SAP's broader AI strategy and helps learners understand their capabilities and limitations.

    Participants explore why enterprise AI differs from general-purpose consumer AI. Business applications require context, security, governance, appropriate model selection, trusted information, and integration with real business processes.

    Learners begin developing the ability to evaluate whether an LLM is appropriate for a particular business problem instead of assuming generative AI is automatically the right solution for every scenario.

  • Lesson 03
    Unit 2: Explaining Product Development for LLM Use Cases at SAP

    A promising AI idea needs to be translated into a viable business solution.

    This unit explores the thinking behind developing LLM-based use cases and helps learners understand how business requirements, user needs, AI capabilities, technical feasibility, quality, and risk influence solution development.

    Participants learn to think beyond the initial AI demonstration and consider what is required to turn an LLM use case into something people can reliably use within an enterprise environment.

    The unit encourages a business-problem-first approach: identify the problem, understand the expected outcome, determine where generative AI adds value, and then design the appropriate solution.

  • Lesson 04
    Unit 3: Employing Prompt Engineering for Your Use Case

    The quality of an LLM response is strongly influenced by the instructions and context provided to the model.

    This unit introduces prompt engineering as a practical skill for designing more useful AI interactions.

    Learners explore how prompts can clearly communicate the task, provide relevant context, define expected output, introduce constraints, and guide the model toward more appropriate responses.

    Rather than relying on trial and error, participants begin developing a systematic approach to prompt design.

    This becomes especially important when prompts need to be reused across business applications rather than written manually for every interaction.

  • Lesson 05
    Unit 4: Applying Techniques to Improve LLM Performance

    Prompt design alone may not always provide enough context for a business scenario.

    This unit introduces additional techniques that can improve the relevance and reliability of LLM outputs.

    Learners explore concepts such as grounding and Retrieval Augmented Generation, where information relevant to a user's request is retrieved and provided to the model as additional context.

    SAP currently describes grounding as connecting generative AI models with external, domain-specific, or current information so that responses can become more relevant to a particular business scenario.

    The unit helps learners understand an important distinction between asking a model to answer from its general knowledge and enabling it to answer using information relevant to the organization.

  • Lesson 06
    Unit 5: Evaluating and Testing LLMs

    A response that sounds convincing is not necessarily a good response.

    Enterprise AI solutions therefore need systematic evaluation.

    This unit helps learners understand how LLM applications can be tested against business requirements and quality expectations.

    Participants explore the importance of evaluating factors such as:

    • Accuracy
    • Relevance
    • Consistency
    • Completeness
    • Instruction adherence
    • Response quality
    • Cost and performance
    • Potential hallucinations
    • Suitability for the intended use case 

  • Lesson 01
    Course Description

    Once learners understand LLM fundamentals, this module introduces the SAP environment used to work with generative AI models and enterprise AI workflows.

    Participants explore the architecture and capabilities of SAP's generative AI hub, including model access and management, prompt-related functionality, and the Orchestration Service.

    The uploaded curriculum specifically identifies understanding the hub's architecture, accessing and managing multiple LLMs, using prompt engineering and model management capabilities, and leveraging orchestration for secure enterprise AI applications as key outcomes.

    SAP's current introductory course also covers integration with SAP AI Core and SAP AI Launchpad, access to multiple models, Model Library, Chat, Prompt Editor, and the Orchestration Service.

    Summary:

    What You Will Learn

    After completing this module, you will be able to:

    • Explain the purpose of SAP's generative AI hub.
    • Understand its relationship with SAP AI Core.
    • Recognize how multiple generative AI models can be accessed.
    • Understand model selection and management concepts.
    • Navigate important generative AI hub capabilities.
    • Understand prompt management functionality.
    • Explain the purpose of the Orchestration Service.
    • Understand how orchestration supports enterprise AI workflows.
    • Recognize security, privacy, and governance considerations.
    • Understand how the hub supports development of enterprise-grade generative AI applications. 
  • Lesson 02
    Unit 1: Describing the Generative AI Hub

    Organizations may need different AI models for different requirements. One model might perform better for summarization, another for reasoning, while another may provide a better balance between performance and cost.

    SAP's generative AI hub provides a managed environment for accessing and working with generative AI models within SAP's enterprise AI ecosystem.

    This unit helps learners understand its architecture and core capabilities.

    Participants explore how the hub can support model discovery, model access, prompt experimentation, prompt management, and AI application development while maintaining enterprise requirements around governance and security.

    Current SAP Learning material identifies interfaces such as Model Library, Chat, Prompt Editor, and Orchestration Service as part of this environment. 

  • Lesson 03
    Unit 2: Discovering the Orchestration Service

    Enterprise generative AI applications often require more than sending a prompt directly to a model.

    A workflow may need to prepare the prompt, select a model, retrieve business context, protect sensitive information, apply safety controls, and process the resulting response.

    The Orchestration Service helps bring these activities together into structured AI workflows.

    Learners explore how orchestration can help developers build more controlled and reusable generative AI solutions.

    Current SAP documentation shows that orchestration workflows can be built, tested, saved as configurations, and executed through SAP AI Launchpad and SAP AI Core. 

  • Lesson 01
    Course Description

    This module moves from understanding the platform to actually building and improving generative AI solutions.

    Learners develop prompts for business scenarios, integrate LLMs into applications using the SAP Cloud SDK for AI, apply more advanced prompt engineering approaches, and compare prompts across multiple models.

    The source curriculum identifies these four areas as the core units of the module.

    SAP's current course also covers prompt templates and versions, Prompt Registry, orchestration workflows, advanced techniques such as few-shot and meta prompting, multimodal inputs, automated evaluation, and comparison of models based on factors including accuracy and cost. 

  • Lesson 02
    Unit 1: Developing Prompts Using Generative AI Hub

    This unit takes prompt engineering from a general concept into the SAP generative AI hub environment.

    Learners explore how prompts can be developed, tested, refined, saved, and reused for business applications.

    Participants also develop an understanding of prompt templates, where dynamic information can be inserted into a structured prompt without rewriting the complete instruction each time.

    For enterprise development, reusable prompts help teams maintain consistency across applications and use cases.

    Learners also become familiar with concepts such as prompt versioning and the Prompt Registry, helping them understand how prompts can be managed as reusable development assets rather than temporary text entered into a chat interface. 

  • Lesson 03
    Unit 2: Leveraging the Power of Large Language Models Using SAP Cloud SDK for AI

    Experimenting with an LLM through an interface is useful, but enterprise applications need programmatic access.

    This unit introduces the SAP Cloud SDK for AI and helps learners understand how generative AI capabilities can be incorporated into application development.

    Participants explore how developers can interact with models, send requests, receive generated responses, and integrate AI capabilities into broader application workflows.

    The unit bridges the gap between prompt experimentation and application development, helping learners understand how LLM functionality becomes part of a real enterprise solution.

  • Lesson 04
    Unit 3: Refining AI Responses Using Prompt Engineering Techniques

    Initial prompts rarely represent the best possible version of an AI interaction.

    This unit develops more advanced prompt engineering skills and helps learners systematically refine model responses.

    SAP's current course specifically identifies techniques including few-shot prompting and meta prompting.

    Learners explore how examples, instructions, context, formatting requirements, and prompt structure can influence the model's output.

    The emphasis is on controlled experimentation: adjust the prompt, evaluate the result, identify weaknesses, and refine the instruction until the response better satisfies the business requirement.

  • Lesson 05
    Unit 4: Evaluating Prompts Using Multiple Models

    Different LLMs can respond differently to exactly the same prompt.

    This unit helps learners compare model behavior rather than assuming a single model is ideal for every use case.

    Participants explore how prompts can be tested against multiple models and how results can be evaluated according to factors such as response quality, accuracy, consistency, latency, and cost.

    SAP's current course specifically includes comparing models for accuracy and cost and automating prompt evaluation.

    The objective is to help learners make more informed model-selection decisions based on the actual requirements of a business scenario.

  • Lesson 01
    Course Description

    The final module moves into one of the most important areas of enterprise generative AI: grounding AI responses in trusted organizational knowledge.

    General-purpose LLMs are trained on broad datasets. They do not automatically know an organization's private documents, current policies, internal procedures, product documentation, or other proprietary information.

    Document grounding helps address this limitation.

    Learners explore how documents can be converted into searchable vector representations, how relevant information can be retrieved according to a user's request, and how that information can be supplied to the LLM as context.

    This forms the foundation of Retrieval Augmented Generation (RAG).

    The source curriculum specifically covers document grounding, vector knowledge bases, configuration of the Document Grounding module in the Orchestration Service, RAG, and reliable enterprise AI solutions. 

  • Lesson 02
    Unit 1: Mastering Document Grounding Using Generative AI Hub

    This unit introduces the end-to-end concept of grounding generative AI responses using enterprise documents.

    Learners explore how organizational information can be prepared as a vector knowledge base and made available for semantic retrieval.

    SAP's current Document Grounding implementation follows a RAG approach and uses vector representations to retrieve relevant document information that can be supplied as context to an LLM.

    A simplified flow looks like:

    Enterprise Documents → Content Processing → Embeddings → Vector Knowledge Base → Semantic Retrieval → Relevant Context → LLM → Grounded Response

    SAP's current documentation explains that document pipelines can fetch information, divide content into chunks, generate semantic embeddings, and store those representations for later retrieval.

    This allows the application to retrieve information relevant to a user's question rather than passing an entire document repository to the LLM.

    The result can be AI responses that are more closely connected to trusted organizational knowledge.

    Summary:

    What Learners Will Explore

    • Document Grounding fundamentals
    • Retrieval Augmented Generation (RAG)
    • Enterprise knowledge grounding
    • Vector embeddings
    • Semantic search
    • Vector knowledge bases
    • Document chunking
    • Retrieval pipelines
    • Grounding configuration
    • Orchestration Service integration
    • Context-aware prompt generation
    • Reducing unsupported AI responses
    • Evaluating grounded outputs
    • Enterprise knowledge-based AI applications 

  • Lesson 01
    Hands-on Practice for Solving your business problems using prompts and LLMs in SAP's Generative AI Hub

    Generative AI skills are developed most effectively through experimentation.

    The uploaded curriculum includes a practice environment where learners can complete hands-on exercises involving prompt development, template management, and workflow orchestration within SAP AI Launchpad.

    SAP's current learning material confirms that this practice environment provides access to a preconfigured SAP AI Launchpad system for completing course exercises.

    Summary:

    Practical Skills You Can Develop

    • Navigate generative AI capabilities in SAP AI Launchpad.
    • Develop and test prompts.
    • Refine prompts iteratively.
    • Create reusable prompt templates.
    • Work with prompt variables.
    • Manage prompt versions.
    • Explore Prompt Registry concepts.
    • Compare model responses.
    • Configure generative AI workflows.
    • Experiment with orchestration.
    • Evaluate AI-generated outputs.
    • Translate business requirements into practical AI scenarios. 

Jittesh Purrohit

Lectures

17

Skill level

Beginner

Expiry period

Lifetime

Related courses