Name: Data Intelligence 2 of 21 ; Connections & Data Sources
Uploaded: 2023-9-6
Duration: 363 s

Share feedback

<p>Planned maintenance of Practice Systems</p>

Planned maintenance of Practice Systems

Why create an SAP account?

Enhance your learning experience

SAP Learning

Subscribe now

Learn more

Live Sessions

Hands-on Practice

Certification

My Learning

Ready to start learning?

<div><div>In this video series, we'll introduce some of the applications when using Data Intelligence. In this video, we'll go through an overview of Connection Management. We'll then be introduced to the Metadata Explorer, and will show how to upload CSV and Parquet files into the Semantic Data Lake. <br><br>0:00 - Introduction<br>1:00 - Connection management<br>2:30 - Upload data to a semantic data lake (SDL) using metadata explorer<br><br>Please note:<br>                     This video was originally published on the SAP HANA Academy YouTube Channel                      and therefore may contain references to SAP HANA Academy and YouTube.                      The tech world is always evolving and the SAP HANA Academy YouTube channel                      is set to close on December 31, 2023.                      At that time, references will no longer be valid                      and will gradually be removed when the videos are updated.<br>Also, this video includes automatically generated captions                      and therefore might misrepresent the spoken content or display incorrect product names.</div></div>

Data Intelligence 2 of 21 ; Connections & Data Sources

Welcome to the SAP HANA Academy. My name is Bob and in this series of videos by Digital Partner Engineering and the SAP HANA Academy we'll be looking at Data Intelligence 3.1. In this video we're going to be looking briefly at the Data Intelligence Connection Manager. We'll look at some of the different connection types, and then we're going to be looking at importing two files, a parquet file and a CSV file using our metadata manager, and these files will be uploaded to our semantic data lake. Before we look at the data, I'm going to show you some of the tools which we'll use to create connections within SAP Data Intelligence. So I'll log into my default tenant, and we have an option of data intelligence security or using cloud platform security. I'm going to use a Data Intelligence user. Of course, depending on the user that you've got will determine which tiles you see when you've logged into Data Intelligence. And these are the tiles that I've got access to. So we'll be looking at the Connection Manager, so I'll select it. The Connection Manager, as you can imagine, enables you to build connections to your various data sources. So, we have three tabs, Connection Types and these are the various data sources that we can connect to. So, you can see things we've got like HTTP, Kafka, Oracle, OData. There's a whole variety of these data types that we can connect to. We can also use open connectors within the SCP cloud platform. Within connections, of course, we've got a list of connections that we've actually built and certificates contains some of those certificates needed in order for those connections to work. So what we'll do is we'll look at one of those specific connection types. If I go to, for example, my ABAP connection, you'll see a list of all the attributes that need to be filled in and whether they're mandatory or not. You'll also have documentation on how those connection types work. Again, if we go to connections, one of the options is if I select a connection on the right hand side, we can check the status of that connection. So here we can see that this connection status is good. So now that we've had a brief look at how to build connections, what we're going to do is import some of our own data. So if I look at that data, we've got two files. We've got a CSV file and we've got a parquet file. So if I go to my downloads folder, here we've got that CSV. And if I open the file in Notepad, we can see that we've got four columns with many rows. So we have a transaction ID, customer ID, a transaction amount and a transaction date. So this is going to be our transactional or our facts table. And then if we go to our parquet file, we can't really view that in Notepad, but there are lots of parquet viewers online. So this is that parquet file. And as you can quite simply see, it's a list of customers with their addresses. And as you can imagine, we're going to be looking at some of the data quality issues in this customer address and name file. Now when it comes to importing files, we can do this directly in a tool which enables us also to profile that data. And that's the Metadata Explorer. So I'll select the tile. And this is the front end to it. So we can browse the catalog of existing objects. We can look at existing connections. And when that data is imported, we can implement things such as rules and glossaries to the columns of that data. We're going to look at that in this series of videos, of course. So what I'll do is I'll first create myself a folder. And this folder is dependent on a connection. So the first thing we need to do is choose our connection. So I'm going to put this into our data lake, which is an SDL type of connection. And SDL stands for Semantic Data Lake. And basically, it's managed by SAP and it can't be modified. Now the two main folders that you would normally use are Shared and External. So we're not going to use External, but it simply provides read-only access to connections for specific authorized users. We're going to be using the Shared folder, which is available by default for read-write access on the object store types defined in your connection. So I'll create myself a new folder, and I'll call this folder SHA. And as well as a notification on the screen, on the top right hand side in our alerts, we'll get a historical notification that the folder has been created, as well as of course any other objects that we create. So we'll need to go into this folder. So I'll search for it. We'll select the folder and then this is where we're going to create all of our content. So to import the files, all I need to do is click on the import icon in the screen. At the moment we need to select the files we want to import. So I'll select them from my desktop or my downloads folder. I'll select the parquet file first, then what I'll do is I'll also select the CSV. We can do this at the same time. So I'll double click on that file, and then to import the files all we need to do is click on upload. They're relatively small files so the import is quite quick. So now that we've got the files and they're in our SAP Data Lake, what we're going to do in the next video is look at profiling the data. You can find more tutorials on our YouTube channel, and if you'd like to be informed as soon as new video tutorials are published, then please subscribe. Thanks for watching.