Sharing SAP BW Data as Custom Data Product

To make a data product available for consumption in SAP Databricks, you have the following options:

• Share the data product from the SAP Business Data Cloud catalog.
• Create a catalog from the Delta Share associated with the desired data product in SAP Databricks.

If you share the data product from the SAP Business Data Cloud catalog, you must specify the following information:

• Target System: SAP Databricks.

• Workspace: a SAP Databricks deployment in the cloud that functions as an environment for your team to access SAP Databricks assets (like notebooks, tables, views, SQL queries, and so on). Depending on its needs, an organization can choose to have multiple workspaces or just one.

• Share Name: only lowercase allowed.

In the following exercise, you will share a data product to SAP Databricks.

SAP Databricks provides advanced data engineering capabilities to SAP Business Data Cloud.

A data scientist can consume, query, process, and transform data products in SAP Databricks, including working with SQL and Python notebooks for various data science and AI/ML projects.

Let’s have a look at the steps which are taken by the data scientist, to perform data analysis on the shared SAP BW data.

1. Locate the shared data product: in SAP Databricks, the data product is accessible as a delta table in the Unity Catalog. The schema and the table (DDS.....) can be retrieved in the folder "Delta Share Received".

2. Perform advanced data engineering using notebooks. For example these tasks:

   • Data preparation
   • Data training
   • Data forecasting
   • Writing forecast results to a delta table

3. Share the delta table via delta sharing: Delta sharing is an open protocol for secure sharing of delta tables. SAP Business Data Cloud supports delta sharing and allows user data sets, represented as shares, to be shared securely. SAP Business Data Cloud SDK is used to create a delta share in SAP Databricks, which includes the delta table and SAP Business Data Cloud as a recipient.

4. Publish the delta share as a data product to SAP Business Data Cloud: To allow the discovery of the shared data in SAP Business Data Cloud, SAP Business Data Cloud SDK is used in SAP Databricks to describe the delta share with the following metadata:

   • ORD: the Open Resource Discovery protocol allows applications and services to self-describe their resources and capabilities. It facilitates cross consumption of resources and capabilities between different systems through a common standard interface.

   • CSN: a standardized format for configuring and describing shares within a network.

   After publishing, the data product is available in the Catalog of SAP Business Data Cloud.