Setting up Local Observability

Objective

After completing this lesson, you will be able to describe the process of setting up local services to meet your local observability goals.

Setting up SAP Cloud Logging Service

Note

This lesson is geared mainly towards administrators, but any of the roles involved could benefit from it.

Business Scenario

As an SAP Business Technology Platform administrator at Rotating Banana, you have to plan and set up the local observability means for your organization, which can be realized via the SAP Cloud Logging service. For that you need an understanding about the use cases (such as workload monitoring, failure analysis, performance analysis) and stakeholders for local observability (such as Developers, DevOps engineers, Site Reliability Engineers, Operators) and derive the requirements to set up SAP Cloud Logging instances that meet the needs in terms of security, authorizations, isolation, usability, sizing, and cost efficiency.

Overview of SAP Cloud Logging

SAP Cloud Logging service is a comprehensive observability solution that serves application developers and operators to analyze their SAP Business Technology Platform workloads at full depth.

SAP Cloud Logging can be used for analysis and automated processing of observability data to better understand performance, errors, resource consumption, communication flows (traces), usage, and other observability characteristics.

It offers dedicated support for SAP BTP runtimes (Cloud Foundry / Kyma) for which smooth data ingestion paths and pre-built analytical dashboards are offered but also supports generic ingest APIs (OpenTelemetry, json) for ingesting logs, metrics, traces from arbitrary sources.

SAP Cloud Logging offers a rich and extensible analytical environment where users can slice and dice through the available data, add new visualizations and dashboards, and define rules for alerting and anomaly detection.

pre-defined dashboard to monitor your application behavior

As an administrator of SAP Cloud Logging, you can determine the size and auto-scaling limits of your instance and control the authentication & authorization scopes of your users.

Defining Your Local Observability Goal

In order to derive your local observability goal, you should address the following aspects:

  1. Scope: Clarify which workloads or other artefacts shall be subject to detailed local observation, i.e., shall emit observability signals to SAP Cloud Logging. This may also relate to different stages of your workloads, such as Dev, Test, or Prod. Last, you might also define overarching goals for what you need to observe for overall administration & operational purposes, including the related alerts you want to put in place.
  2. Legal/Authorization Constraints: Clarify which data may reside in a common SAP Cloud Logging instance or requires the usage of SAP Cloud Logging in a specific region. Separating data into different instances is definitely the strongest isolation approach. However, you can also use different SAP Identity Authentication Service (SAP IAS) roles and index/document-level security features from SAP Cloud Logging to satisfy authorization constraints.
  3. Joint Analytics: Check for scenarios where the joint analysis of multiple workloads would be beneficial, so that you would benefit from putting the observability data into the same instance.
  4. Sizing (Ingest & Storage): Determine the volume of data that needs to be ingested and stored, including the required retention period. This will influence the number of instances, the appropriate service plan, and the limits to which you configure the auto-scaling of ingest and storage components. The service innovation guide and the capacity unit estimator will help you derive this information.
  5. Operations: While shared SAP Cloud Logging instances may be beneficial in terms of analytics and cost, they also might create operational overhead on how to share such instances among multiple teams. The instance sharing guide will help implement this. The opposite approach might be to allow different teams to run their own SAP Cloud Logging instance.

Possible Setup across regions and compliance domains

Setup of SAP Cloud Logging Instances

Based on your local observability goal, you should have a plan in which global accounts, sub-accounts and regions you want to set up SAP Cloud Logging instances.

  1. The most important prerequisite is the setup of the underlying Identity Service and its authentication application as described in here. This will also cover the definition of groups and the assignment of admin users.
  2. With that you can create the respective SAP Cloud Logging instances from the SAP BTP service marketplace, taking care that their security configuration (Security Assertion Markup Language - SAML) matches the setup in your Identity Service.
  3. Application developers or workload owners can then bind to the respective service instance and start emitting observability signals. They can follow the SAP BTP Developer Guide possibly benefiting from the specific mission "Implement Observability in a Full-Stack CAP Application Following SAP BTP Developer’s Guide".

Solution Diagram how to Implement Observability in a Full-Stack CAP Application Following SAP BTP Developer’s Guide

Once SAP Cloud Logging instances are up and running, you may configure / use them to your specific needs, e.g.:

  • You may define specific alerts that support your administrative or operational goals.
  • You might even create own visualizations and dashboards that help you to oversee most relevant observability signals at a glance.

Set up SAP Alert Notification Service

The SAP Alert Notification service of SAP BTP collects crucial technical information from various sources and creates real-time events. The events are ingested into the service by SAP BTP applications and services, other products delivered by SAP, or by third-party tools and systems. DevOps teams can set conditions to filter the events out, thereby focusing only on the relevant ones.

The service supports an integration with SAP Cloud ALM, ensuring a seamless DevOps and Operations experience across your solutions. Otherwise, the SAP Alert Notification service for SAP BTP can deliver the events of your interest to a channel of your choice or trigger different predefined actions.

Watch the following video to find out more about this service.

To set up SAP Alert Notification service, see Initial Setup | SAP Help Portal.

Summary

You should now be able to describe the process of setting up SAP Cloud Logging service to meet your local observability goals.