Name: Data Intelligence 11 of 21 ; Running & Copying Graphs
Uploaded: 2023-9-6
Duration: 310 s

Share feedback

<p>Planned maintenance of Practice Systems</p>

Planned maintenance of Practice Systems

Why create an SAP account?

Enhance your learning experience

SAP Learning

Subscribe now

Learn more

Live Sessions

Hands-on Practice

Certification

My Learning

Ready to start learning?

<div><div>In this video series, we'll introduce some of the applications when using Data Intelligence. In this video, we'll go through running and copying graphs when using the Modeler.<br><br>0:00 - Introduction<br>0:30 - Running a graph<br>1:00 - View results in Metadata Explorer<br>2:00 - Copy graph<br>3:45 - Execute graph<br><br>Please note:<br>                     This video was originally published on the SAP HANA Academy YouTube Channel                      and therefore may contain references to SAP HANA Academy and YouTube.                      The tech world is always evolving and the SAP HANA Academy YouTube channel                      is set to close on December 31, 2023.                      At that time, references will no longer be valid                      and will gradually be removed when the videos are updated.<br>Also, this video includes automatically generated captions                      and therefore might misrepresent the spoken content or display incorrect product names.</div></div>

Data Intelligence 11 of 21 ; Running & Copying Graphs

Welcome to the SAP HANA Academy. My name is Bob and in this series of videos by Digital Partner Engineering and the SAP HANA Academy we'll be looking at Data Intelligence 3.1. In this video we're going to look at running and copying graphs when using the Modeler. In the previous video we used the Data Intelligence Modeler to build a graph which simply reads some files from an S3 bucket, a folder in an S3 bucket, and then consolidates them into a singular file. It simply appends them all together. Now that we've built the graph, we will want to run it and test that it works correctly. So to run the graph, we're going to select this option at the top. So it will indicate that the graph has been scheduled for execution and we can see that it's pending. Now we can see that the graph is running and here we can see that the graph completed. All of this took just a few seconds. So to see the results we're going to want to go back to the Metadata Explorer. So if I browse my connections, again the output is in our semantic data lake, which is di underscore data lake. If we go to the Shared.sha folder, and I can filter on that folder. What we'll have now is a performance.csv file as you can see here. So if I do a data preview of that file we can see the data. So I'll go to my Looking Glasses, and if we go to Data Preview, here we can see a consolidation of all those files in one big file called Performance.csv. Now remember we have two folders in our S3 buckets. We have a device performance folder, but we also have a device configuration folder. So we'll want to do the same thing to all the files within the device configuration folder. So we can do this by replicating this graph and changing some of the parameters. So what I'll do is a Save As and I'll change this to File Collection Configuration. I'll remove the underscore copy and I'll click on OK. What I'll do is I'll just to show you I can change the layout of the operators on the screen. And I'll configure list files by going to open configuration. So as you can imagine all we'll need to do is change the folder path to device configuration. We've not finished yet. We need to do one more change and that's obviously the target name. And for us we just need to configure that target name within our append file operator. So here I'll just change the path from performance to configuration like so. So when I've done that all I need to do is save the graph. And then what we'll do is we can clear the status. We don't need to have all this. We know that we've saved the files and there should be no errors because the other graph worked. And when we've done that all we need to do of course is execute the graph. So before we execute what we'll do is we'll go back to our Metadata Explorer just to show you that that configuration.csv doesn't exist here. And now what we'll do is we'll execute this graph. Again, we can see in the log file that it's scheduled to execute. So we'll go to the status, we can see it's pending. It's running now. And here we could see it's completed. So now that it's completed, we can look at the results. So we know it's worked, there's been no issues. We can delete the status and if I go back to my Metadata Explorer, we don't see the file yet because we need to refresh this screen within the Metadata Explorer. Here we can see that extra file which is configuration.csv. And if I do a data preview, here we can see all the values for that configuration.csv file. Now that we've got the two sets of files within the SRE book, it's consolidated into two separate files within our semantic data lake, what we're going to do in the next video is look at joining this data together. You can find more tutorials on our YouTube channel, and if you'd like to be informed as soon as new video tutorials are published, then please subscribe. Thanks for watching.