Sharing Results Back to SAP Business Data Cloud

Objective

After completing this lesson, you will be able to share machine learning results back to SAP Business Data Cloud

Integration of Machine Learning Results into SAP Business Data Cloud

When you've generated the results from your machine learning models in SAP Databricks, you can share these results back to SAP Business Data Cloud to create a custom data product.

Create a Custom Data Product from SAP Databricks

One of the key use-cases for sharing your Databricks results back to SAP Business Data Cloud is to enrich the standard SAP-delivered data products with machine learning data from SAP Databricks. You achieve this by first generating a custom data product from the SAP Databricks machine learning results, and then you build a data model in SAP Datasphere that combines the standard SAP data product with the custom data product.

To share the machine learning results from SAP Databricks with SAP Business Data Cloud you first need to store the results in a delta table. Once you have the new delta table in your SAP Databricks catalog, you will be able to create a delta share and then later, a custom data product.

Create the Delta Share

To create a new delta share in SAP Databricks, open the Catalog Explorer and choose the Manage icon to open the Delta Sharing management page.

Delta Sharing option is highlighted under the Manage menu option in the SAP Databricks catalog menu.

In the section Delta Sharing switch to the Shared by me tab and choose Share data button.

Delta Sharing page with a 'Share data' button available for initiating data sharing.

In the Create share step, enter a name and a description for the new share.

Step 1 prompts to create a share with fields for share name and description.

In the Add data assets step, select the delta tables you want to share.

Step 2 in the process highlights adding data assets, with cashflow_prediction table selected from the cashflow_forecast_catalog.

You can skip the Add notebooks step since you are not sharing notebooks in this example.

In the Add recipients step, choose the sap-business-data-cloud target system.

Recipient dropdown menu offers sap-business-data-cloud as a selection option in the Add recipients step.

You now have a new share available in the SAP Databricks workspace.

Catalog Explorer lists a cashflow forecasting share.

Create the Data Product

To use the delta share as a new, data product in SAP Business Data Cloud, you need to create two special files using Python code before you can publish the data product.

An Open Resource Discovery (ORD) file is required to describe the resources and capabilities of your data product. The ORD protocol is an open standard protocol, originally developed by SAP, and can be used by any compliant data provider to expose data products, and by data consumers for discovery of data products.

Code to generate ORD file.

A Core Schema Notation(CSN) file is required to describe the data product structure, for example data entities, properties, and relationships. You can think of a CSN file as the official contract for the data. It provides a clear, human-readable, and machine-readable definition that ensures both developers and automated systems have a consistent and reliable understanding of the data model.

Code to generate CSN file.

Once you have created the files, you can publish your data product.

Code to publish data product.

Access the New Data Product in SAP Business Data Cloud

Now that the new data product is shared from SAP Databricks, you can access it in SAP Business Data Cloud.

You'll find the data product listed in the SAP Business Data Cloud catalog.

You'll then be able to install it in a SAP Datasphere space and consume it as any other data product.

Summary

  • Create a delta share in SAP Databricks by selecting delta tables and choosing SAP Business Data Cloud as the recipient.
  • Develop an ORD file and a CSN file to describe and structure the new data product for SAP Business Data Cloud.
  • Share the generated data product back to SAP Business Data Cloud to enhance SAP-delivered data products with SAP Databricks data.
  • Access and install the new data product in SAP Datasphere for consumption.