Describing SAP AI Foundation

Objective

After completing this lesson, you will be able to describe SAP AI Foundation.

SAP Document AI

SAP AI Business Services Overview

SAP Document AI is a standalone service on SAP Business Technology Platform designed to automate the processing of business documents. It addresses a fundamental challenge in many enterprise processes: critical business data is still contained in unstructured or semi-structured documents such as PDFs, scanned images, or email attachments. Typical examples include supplier invoices in finance, delivery notes in logistics, customer orders in sales, and quality certificates in quality management. Before this information can be processed in SAP systems, it must be extracted and transformed into structured data.

From a technical perspective, SAP Document AI focuses on document understanding as a dedicated capability within end-to-end process automation. Documents are provided to the service via APIs or SAP application interfaces. Channels such as email inboxes, mobile capture, or cloud storage are usually handled by upstream BTP services, which forward documents to SAP Document AI for analysis. Once received, the service applies optical character recognition (OCR) to extract text, classifies the document type, and identifies predefined business-relevant fields using document-specific AI models.

A key aspect of the solution is human-in-the-loop validation. Extracted values can be reviewed and corrected through a user interface. Depending on the scenario and configuration, this feedback can be leveraged to improve extraction quality over time. SAP Document AI itself does not orchestrate business workflows; instead, it provides reliable, structured document data that can be consumed by downstream services or SAP applications for further processing.

Within the SAP landscape, SAP Document AI is typically used where document data must be matched with existing business objects. A common example is delivery note processing: quantities and item references are extracted from an incoming document and matched against existing documents in SAP S/4HANA before follow-up actions are triggered. This approach reduces manual data entry while preserving integration with standard SAP business processes.

SAP Document AI Capabilities

Capabilities Overview

  • Ingestion of documents via APIs and SAP application interfaces.
  • OCR-based text extraction from scanned and digital documents.
  • Classification of document types and extraction of predefined business fields.
  • Preconfigured content for standard documents such as invoices, delivery notes, and quality certificates.
  • Validation interface for reviewing and correcting extracted data.
  • Use of user feedback to improve extraction quality over time.
  • Integration into automation scenarios within the SAP application landscape.

Learn More

Learn more about SAP AI Business Services in the official product documentation.

Generative AI Hub

What is the Generative AI Hub?

The Generative AI Hub is a set of capabilities within the AI Foundation that provides unified access to a broad range of generative AI models and orchestration tools. Its purpose is to simplify the use of LLMs and other generative AI technologies in business applications built or extended on SAP BTP.

Instead of interacting directly with individual model providers, vendor-specific APIs, or runtime details, developers use the Generative AI Hub as a single place to:

  • Access frontier models from various providers.
  • Experiment with and manage prompts.
  • Integrate generative AI into applications.
  • Manage the lifecycle of prompts and the usage of models.
  • Combine generative AI with business context stored in SAP systems.

GenAi Hub

The Generative AI Hub provides a consistent interface regardless of where a model runs or which underlying technology is used.

Core Capabilities of the Generative AI Hub

Model Access

The Generative AI Hub enables access to a wide selection of generative AI models, including large language models from multiple providers as well as fine-tuned or custom models. The primary goal is to reduce technical complexity and allow developers to select or switch models without changing application logic.

Prompt Experimentation and Lifecycle

The Generative AI Hub provides tools to design, test, validate, and version prompts. This enables controlled usage of generative AI and helps ensure consistent behavior across development, testing, and productive scenarios.

Model Orchestration

Generative AI scenarios often require more than a single model call. Typical elements include:

  • grounding responses with business data
  • post-processing and validation logic
  • integration with SAP APIs and services

The Generative AI Hub supports such orchestration by leveraging the underlying runtime capabilities of SAP AI Core and providing a common operational approach.

SAP AI Core: The Runtime for AI Workloads

The Generative AI Hub builds on SAP AI Core by leveraging its runtime capabilities to execute prompt requests, inference workloads, or model deployments. This separation allows developers to focus on generative AI usage and orchestration, while SAP AI Core ensures reliable and scalable execution.

SAP AI Core is SAP’s runtime for heavy-load AI. It allows you to train and deploy your AI models cost-efficiently at scale. You benefit from accelerated performance with GPU support while ensuring cost-efficiency by choosing from a broad range of storage, CPU and GPU service plans, as well as by benefiting from built-in autoscaling and scale-to-zero.

Furthermore, you benefit from SAP-managed model deployments that hide the complexity of managing deployments from you and simply expose an API endpoint that you can integrate and consume in your business applications. You can integrate your AI use cases built on SAP AI Core via the unified AI API.

The AI API is not a product but a unified API definition that AI runtimes implement, such as SAP AI Core, and to which consuming applications can connect to. With this unified API definition, you benefit from unified consumption in your business applications and unified operations and management in SAP AI Launchpad.

SAP AI Launchpad: Managing AI Scenarios

SAP AI Launchpad is the central application to access and manage your AI use cases. You can connect to multiple runtimes via the unified AI API and streamline the AI lifecycle management of your use cases within SAP AI Launchpad. On the one hand, you benefit from centralizing your AI lifecycle management in a single tool, and, on the other hand, you benefit from the unified AI lifecycle in AI API, without requiring you to know service-specific details.

Furthermore, you can continuously monitor your models in SAP AI Launchpad and improve their performance based on the insights. You can capture metrics from your training runs and compare the metrics across models as well as visualize them in charts to gain deeper understanding. This allows you to identify the configurations that achieve optimal performance.

For generative AI, the SAP AI Launchpad allows developers and operators to observe activities triggered via the Generative AI Hub, such as prompt executions or model deployments. While the Generative AI Hub is used to design and invoke generative AI scenarios, SAP AI Launchpad provides the centralized operational view to monitor and manage these scenarios across runtimes.

Putting It All Together

The SAP AI Foundation provides the technical basis for building and operating AI-driven extensions and solutions on SAP Business Technology Platform.

Within this foundation, the Generative AI Hub acts as the central entry point for working with large language models (LLMs), generative AI capabilities, and model-driven logic.

It abstracts much of the complexity behind modern AI technologies and makes them accessible in a unified and consistent way across SAP BTP.

While the Generative AI Hub is the main interface for developers, it works closely with two underlying components:

  • SAP AI Core – the scalable runtime for AI workloads
  • SAP AI Launchpad – the central application to manage and monitor AI scenarios
  • AI API – the unified API definition connecting consuming applications to AI runtimes

Note

The AI API is not a standalone product, but a shared API definition that ensures AI runtimes can be consumed in a consistent way. Applications connect to AI scenarios through the AI API, and runtimes such as AI Core implement this interface.

Together, these elements form the technical environment in which generative AI can be explored, integrated, and brought into production on SAP BTP.

Key Takeaways Of This Lesson

SAP offers multiple services or applications in which AI is already included; SAP AI Business Services for example. Using those services in your company enables you to transform your manual working steps into automated business processing.