Monitoring Customer Data Ingestion in SAP Customer Data Platform

In this lesson, you will learn how to effectively utilize the Ingestion Monitoring Dashboard within SAP Customer Data Platform to track and analyze data ingestion processes, gaining valuable insights into metrics such as total received data, succeeded records, failed records, and discarded payloads.

Whenever you want to troubleshoot failed customer data ingestion, or just check the performance and metrics of all incoming customer data events, you can leverage the Ingestion Monitoring Dashboard to analyze insights and know more on some key metrics. In the below Monitoring Dashboard image, you can see various metrics displayed related to data ingestion and activities.

The total amount of incoming customer data records during ingestions, regardless of the succeeded, fail, or discarded resulting status. These could be profile, group, or activity data.

The amount of customer data records ingested into your business unit. This total includes all new or updated customer data.

Total failed show the records that failed importing. The cause for failure can be problems with configuration of the source application or the event that processed it.

The discarded records that could not be ingested by SAP Customer Data Platform. It happens when matching data already exists in the system, but either the ingested date is past the existing activity (cut date, or delta ingestion) or you have activity override disabled for the respective activity schema being ingested. This metric shows the total discarded for any type of customer data, including profile, group, and activity data.

This is a bar chart graphic that shows the total succeeded, failed and discarded key metrics over time. Use the date range selector to expand or narrow down the period that you want to visualize (up to 30 days in the past).

Updated vs new customers show the number of profile data records updated or created across all ingestions over a period of time.

Updated vs new activities show the number of activity data records updated or created across all ingestions over a period of time.

Updated vs new groups show the number of group data records updated or created across all ingestions over a period of time.

Event failures show how many individual events payloads failed across all ingestions over a period of time.

Activity discarded is the same as total payloads discarded, but only for activity data.

In the following video we will explore Ingestion Monitoring Dashboard overall key metric totals, the Events Table containing key metric totals per event, and the Event Overview showing possible Event Failures, Payload and Activity Discarded total metrics.

• Access Monitoring
• Navigate to Ingestions Monitoring Dashboard
• Set Date Range
• View Detailed Metrics
• Analyze Received Payloads
• Examine Congestion Monitoring Metrics
• Review Events Table
• Analyze Single Event Configuration
• Inspect Event Failures
• Summarize Process

In the following video we will show the last 20 failures for one of the Event Overview grouped Event Failures, Payload and Activity Discarded occurrences, and also analyze the root cause by checking the Events Message Details Page of one particular payload ingestion issue.

1. Access event failures.
2. View event message details.
3. Review error messages and next steps.
4. Examine metadata and event configuration.
5. Inspect ingested payload.

In this lesson we navigated across the Ingestion Monitoring Dashboard to identify key metric totals, and also explored the Events Table to check the total ingestion issues per event, narrowing down to a single event using the Event Overview page, and finally we checked the last 20 ingestion issues of that event, and its detailed message information by going throughout the Event Message Details Page to analyze the issue data attached to the event execution payload.