Name: Data Intelligence 6 of 21 - Data Quality Rule Dashboards
Uploaded: 2023-9-6
Duration: 367 s

Share feedback

<p>Planned maintenance of Practice Systems</p>

Planned maintenance of Practice Systems

Why create an SAP account?

Enhance your learning experience

SAP Learning

Subscribe now

Learn more

Live Sessions

Hands-on Practice

Certification

My Learning

Ready to start learning?

<div><div><div>In this video series, we'll introduce some of the applications when using Data Intelligence. In this video, we'll go through using the Metadata Explorer to build scorecards and dashboards based upon the values of your rules. We'll also look at the concept of Rule Bindings.<br><br>0:00 - Introduction<br>1:00 - Create new rule binding<br>2:00 - Run rulebook execution<br>3:00 - View results<br>4:00 - Rules dashboards and add scorecard<br><br><br>Please note:<br>                     This video was originally published on the SAP HANA Academy YouTube Channel                      and therefore may contain references to SAP HANA Academy and YouTube.                      The tech world is always evolving and the SAP HANA Academy YouTube channel                      is set to close on December 31, 2023.                      At that time, references will no longer be valid                      and will gradually be removed when the videos are updated.<br>Also, this video includes automatically generated captions                      and therefore might misrepresent the spoken content or display incorrect product names.</div></div></div>

Data Intelligence 6 of 21 - Data Quality Rule Dashboards

Welcome to the SAP HANA Academy. My name is Bob and in this series of videos by Digital Partner Engineering and the SAP HANA Academy we'll be looking at Data Intelligence 3.1. In this video we'll be looking at rule bindings and dashboards when using the Metadata Explorer. In the previous video we looked at the concept of creating rules and rule books within the Metadata Explorer. So we have a rule here and as the description says the column mustn't be null and it must contain the letters US in capitals. That's our singular rule in our singular rule book. Now we've tested this rule on some test data but we want to apply it to our parquet file which contains a list of our customer addresses. The way we do that is with rule bindings. So on the right hand side of the rule we have this option which says the rule has no rule bindings So we'll need to create one. So, within the three dots, if I select it we can go to our rule bindings. So I'll need to create a new rule binding, and the first thing we'll need to do is choose the data set. So of course I'm going to go to my semantic data lake. So if within the browse I select the connection, which is that DI data lake, then we'll go to the shared folder, SHA, and then I'll choose that customers us parquet file. Once I've chosen, all I need to do is click OK. And now that we've associated the data set, which is that parquet file, what we need to do of course is associate the column to the parameter. So at the bottom we can see we've got that option which is expecting a parameter. So we want to map the country parameter to that country column. So now that we've got a rule in the rule book and the rule book associated with the rule binding, which of course links to that Parquet file, what we want to do is run this rule. So at the top we've got run all, so if I select run all, we can see that the rulebook execution started. In the real world you're going to have a lot of rules, so this could take a bit of time. Now if I go to my monitor, within monitor tasks we can see that the rule is currently running on that data set. Of course we get the alert on the top right hand side. Here we can of course filter as well for our specific rules. The rules still running. It will just take a few seconds because it's only one rule in one rulebook. Well here we can see it is completed, and of course we have the alert at the top right hand side to show it started and completed so I will just clear that alert. So what we want to do now, is see the results. So, there are different places we can see the results, in the monitoring tab we can see them here, on three dots on the right hand side. So all I need to do is select View Rule Book Results. So we've only run it once, we've got 78.7% accuracy. And we've only got one data set. If I expand the data set here you can see more detailed information. The category where the rule was. And also detailed information on the failed rows. So here we can see we sent 329 rows. We didn't filter any of those rows, and we passed 259 of those rows. If we select a few failed rows, here we can see on the right hand side a few of the rows that failed. And you can see examples here of the full details for each of those rows. Of course, this is an iterative process. So you're going to want to run these rule bindings and rule books again and again over the same data set. If you import more data and of course if you apply more data quality rules. To see more detailed analysis we just need to go to our rules dashboards. Here you can see some of those dashboards but I'll create my own. So I'll click on the plus. We'll give our dashboard a name and a description. And then we need to choose a scorecard. So I'll select Add Scorecard and that will come from a rule book. So we need to choose our SHA rule book and it's a step-by-step process. If we go to step two, then what we need to do is choose which reporting type we want to focus on, whether it's a data set, a category or a rule book. I'm going to focus on a specific data set. We can compare data sets or we can look at trends over time for the same data set. I'm going to look at a single data set. Again, you can compare two different data sets, or look at the same data set over time. You've also got a choice of the reporting type, whether it's a score or a percentage. I'm going to choose percentage. Delta value means we can compare it to the previous score. Next I'll need to choose the data set which is that parquet file and then we'll go to step five which is the last step. Here we just need to give our scorecard the name and also choose a subtitle if we want and here's that first scorecard on your dashboard. Of course, if you had multiple rules or you had multiple data sets, you could have multiple of these scorecards on each of your rules dashboards. So now that we've looked at the concept of rules in the past few videos, what we're going to do in the next video is look at the concept of self-service data preparation. You can find more tutorials on our YouTube channel, and if you'd like to be informed as soon as new video tutorials are published, then please subscribe. Thanks for watching.