Introduction
SAP Datasphere provides a large set of default Built-in-connectors to access data from a wide range of sources, in the cloud or on-premise, from SAP or from non-SAP sources or partner tools.
Connections provide access to data from a wide range of remote systems, cloud as well as on-premise, SAP as well as non-SAP, and partner tools. They allow users assigned to a space to use objects from the connected remote system as source to acquire, prepare, and access data from those sources in SAP Datasphere. In addition, you can use certain connections to define targets for replication flows.
Watch this video to understand how to create connections for integrating SAP applications.
Create a connection to allow users assigned to a space to use the connected source or target for data modeling and data access in SAP Datasphere.
To learn more about integrating SAP applications, refer to the how-to paper by SAP at: https://help.sap.com/docs/SAP_DATASPHERE/be5967d099974c69b77f4549425ca4c0/8f98d3c917f94452bafe288055b60b35.html?locale=en-US.
Each connection type supports a defined set of features. Depending on the connection type and the connection configuration, you can use a Connection for one or more of the following features:
- Remote Tables
A typical scenario for virtual data access is building a view on top of remote tables. The editor for building graphical views supports the creation of remote tables. You as a modeler can add a source object (usually a database table or view) from an existing connection by drag and drop and use it within your graphical view. The source object deploys a remote table.
Depending on the connection type, you can use remote tables for the following tasks:Directly access data in the source (remote access)
Copy the full set of data (snapshot or scheduled replication)
Copy data changes in real time (real-time replication)
- Data Flows, Replication Flows, and Transformation Flows
The flow feature supports building data flows, replication flows, and transformation flows. After you as a modeler have created a connection, in the respective flow editors of the Data Builder, you can add a source object from the connection to a data flow to integrate and transform your data.
- External Tools
SAP Datasphere is open to SAP and non-SAP tools to integrate data to SAP Datasphere.
By default, when you import a remote table, its data does not replicate and you must access it using federation each time from the remote system. You can improve performance by replicating the data to SAP Datasphere and you can schedule regular updates (or, for many connection types, enable real-time replication) to keep data fresh and up-to-date.
Integration Architecture
SAP Datasphere leverages different technologies to setup connections to sources. Most SAP Datasphere connection types support creating views and accessing or replicating data, but different connection types have different prerequisites and provide different functionality and user experience. You need connections for remote tables and flows.
1. Remote Tables
Remote Tables take data 1:1. If you need data transformation, you must use additional objects, such as views, data flows, or transformation flows.
Prerequisites - Data Provisioning Agent:
Before using the connection, it requires an appropriate setup. For this purpose, use SAP HANA Smart Data Integration (SDI) and its data provisioning framework (DP Server + DP Agent). The DP Agent is a lightweight component running outside the SAP Datasphere environment. It hosts data provisioning adapters for connectivity to remote sources, enabling data federation and replication scenarios. The DP Agent acts as a gateway to SAP Datasphere providing secure connectivity between the database of your SAP Datasphere tenant and the adapter-based remote sources. The DP Agent is managed by the Data Provisioning Server. It is required for all SDI connections in general. Through the Data Provisioning Agent, the pre-installed data provisioning adapters communicate with the Data Provisioning Server for connectivity, metadata browsing, and data access. The Data Provisioning Agent connects to SAP Datasphere using JDBC. It needs to be installed on a local host in your network and needs to be configured for use with SAP Datasphere.
There are some source types which use alternative methods. For example SAP SuccessFactors or SAP HANA Cloud are capable of using direct connection without additional setup. Others support SAP HANA Smart Data Access (SDA) with the Cloud Connector (e.g. SAP HANA on premise).
2. Flows
You can integrate SAP Data Intelligence (DI) connectors which are embedded in SAP Datasphere to extract data from remote sources using Data Flow or Replication Flow functionality.
Prerequisites - Cloud Connector:
To establish a connection to these sources a Cloud Connector is required to act as link between SAP Datasphere and the source. Before creating the connection, the Cloud Connector requires an appropriate setup.
The Cloud Connector serves as a link between SAP Datasphere and your on-premise sources and is required for connections that you want to use for following use cases:
Data flows
Replication Flows
Model import from SAP BW/4HANA Model Transfer connections (Cloud Connector is required for the live data connection of type tunnel that you need to create the model import connection)
In rare cases also for Remote tables: Only for SAP HANA on-premise via SDA.
Documentation of connection types:
Preparing Connectivity for Connections: