The core component of a custom data warehouse is the database. The database is where we store and manage the data that we collect from the source systems. In addition to the database, we need tools to extract and cleanup the data and integrate it with existing data already loaded to the data warehouse. We need tools to develop flexible data models for consumption by analytics. Some databases include these tools.
In this course, we will build a custom data warehouse using the SAP HANA database. SAP HANA provides all the tools you need to build and run a custom data warehouse.
Let's take some time to learn about the key features of the SAP HANA database so that we understand how it will support the development of a custom SQL data warehouse.
SAP HANA is an in-memory, column-oriented, relational database management system. Its main role is to support applications with services such as data storage and data processing. Unlike many databases that rely on disk technology, SAP HANA stores data in memory so ensure fast processing. SAP HANA runs on the latest hardware utilizing multi-core CPUs for fast, parallel processing. SAP HANA can scale-up and scale-out to many terabytes of memory to ensure organizations can keep up with the demands of data growth.
SAP HANA supports mission critical applications by providing high-availability and disaster recovery services such as scale-out and auto-recovery.
SAP HANA is more than a database. SAP HANA is a comprehensive platform to develop and run complete applications. SAP HANA includes a complete application development environment that consists of development tooling and an application run-time environment. This means you can build full stack applications (front-end, application layer, database) using multiple languages, that are completely integrated with the SAP HANA database, without requiring any other software.
Other key features of SAP HANA include an integrated web server which supports server side JavaScript and OData, a graphic modeler that supports the creation of data powerful data models, and the Application Lifecycle Management tool that helps to perform version control, bundle, transport, and install applications.
In addition, SAP HANA also comes with a set of powerful data processing services to process non-structured data such as spatial, textual and graph data.
For building a custom data warehouse, many of these features are not required and it is usually the core database features of SAP HANA that are needed.
Note
SAP HANA includes support for building data integration pipelines. For example, you can integrate data from remote tables virtually, or setup batch or real-time replication jobs to move the data to SAP HANA, from any data source. You can build sophisticated data-flow pipelines to support complex extraction, transformation and loading (ETL) and also extraction, loading, and transformation (ELT) scenarios.
The main tool used in the development of all application and database artifacts in SAP HANA is a browser tool called Web IDE for SAP HANA (usually referred to as Web IDE).
NoteThe Web IDE provides code editors and graphical tools. The Web IDE also includes a tool called the Database Explorer that is used to work directly with the database when you want to explore tables and other database objects.
The best place to get started with SAP HANA is by working with the Database Explorer to become familiar with the basic features of the database.
Launch the video below to learn how to explore the SAP HANA database.
NoteThe Data Warehousing Foundation (DWF) is an optional SAP HANA add-in that provides tools to support the development of a custom data warehouse. The DWF tooling includes a data load scheduler and data load monitor as well as other tools. Please be aware that from April 2024, DWF is no longer developed by SAP and has been retired. DWF should no longer be used in your new developments. Instead you should explore the other options within the SAP HANA platform to support data load scheduling and monitoring.