Creating Process Chains

Objectives

After completing this lesson, you will be able to:

  • Generate procuess chains manually.
  • Generate a Process Chain from a Data Flow.

Creating a Process Chain in BW Bridge Cockpit

Now, you have created models for product, customer, and sales data, then you have filled tables and used the data in higher-level views and reports. But, loading data manually for many models would be too much work. Therefore, you want to automatize this process. SAP Datasphere SAP BW bridge offers an object type that specifies a sequence of run-time steps such as loading or deleting data: the process chain. In contrast to a simple task list, a process chain can define which tasks run in parallel.

This screen capture shows a process as an example. The structure of a Process is explained. At the top of the process visualization, you see the process type, in this case Execute DT. At the bottom, there is the icon with magnification glass Details that shows the configuration that determines the process variant. Here, the name and description of the Data Transfer Process.

In this lesson, let’s delve into creating, managing, and scheduling process chains and the related terminology:

  • Process type: Each process step belongs to exactly one process type and each type belongs to a process category, based on its function. For example, a process chain can contain two different processes of the process type Data transfer process from category "Loading process and postprocessing". It defines the tasks that the process will perform and the required parameters you have to provide during maintenance.
  • Process variant: A process variant is a stored set of parameters for a specific process type, for example, it specifies a specific DTP. A variant is useful because it allows you to reuse the specific configuration of a process when defining a new one.
  • Process instance: This is the actual occurrence of the process when the chain is running.

To understand the relationship between these terms, imagine that you are cooking a meal. The process types are similar to the dishes, such as pumpkin soup, lasagna, or ice cream. To make it easier to find what you need, they are grouped into categories such as appetizer, side dish, main dish, and dessert. Typically, you want to make sure that the appetizer is served first, then the main course with the side dishes in parallel, and dessert after everything else is eaten. The process variant is like the version of the recipe that you want to follow, for example, it determines which ice cream flavor you use and how many scoops you serve. The instance is like a cooking event - each time you use a different pot, and the duration is slightly different.

The process type and variant allow for customization and flexibility in your data management tasks. They are the building blocks of a process chain. The instance is the key for traceability and accountability, ensuring you can accurately track and log each step within your chain for auditing and troubleshooting purposes.

Let’s have a look at a few important process types:

Start Process: The start process defines the start conditions of a process chain. Every chain needs one start process at its beginning, like turning on the electricity is necessary before you start cooking. The same start process cannot be used in other process chains.

You must define a start process with one of the following conditions:

  • Immediate start upon scheduling the chain
  • Start at a specified time, similar to setting an alarm clock.
  • Event: Start after a particular event.
  • It can be raised using an API based on an event from a source.
  • It can be triggered by another process chain, known as a meta chain.

Collector Process: If parallel paths are defined in a process chain, a collector process ties them together and defines in which case a subsequent process is started. The following collector processes exist:

  • AND (last): All predecessor tasks must be completed and the subsequent job starts when the last predecessor is finished.
  • OR (each): Each completed predecessor task triggers an instance of the subsequent process.
  • XOR (first): Any predecessor process must be completed and only the first finished predecessor job triggers the subsequent process.

Launch the following video to learn how you create a process chain.

To sum up, here are the steps:

  1. Select 'Create' to begin a new process chain. You are greeted with a canvas in the graphical editor, representing the space where you’ll map out your chain.

  2. Insert Processes: Use buttons like Insert Process, Insert Collector, and Insert Decision to add different types of nodes to your canvas.

  3. Connect Nodes: Draw connections between nodes to establish the flow of processes. For most of the nodes, you can specify if the successor should run:
    • only in case of error
    • only in case of success
    • or in all cases
  4. Define Details of the Processes: For each node, specify the process type and parameters. One parameter is typically the name of the object and other parameters are performance settings or limits.

  5. Use the Properties button to define properties for the process chain, for example the job priority.
  6. Save, activate, and schedule the process chain then start the monitor.

Process Chains for Streaming

Process Chains for Streaming are specifically designed to start and execute data loading and transformation processes that need to occur very frequently, sometimes even in real-time. Think of it like a continuous conveyor belt in a factory, constantly moving products (in this case, data) through various stages. Typically, they only contain a start process, some data transfer processes and a process to activate the loaded data in the target. Housekeeping tasks such as removing data from a change log table cannot be integrated in a process chain for streaming.

Process Chains for Streaming are a key advantage of SAP Datasphere, SAP BW bridge. Let’s now see how they work.

Process Chains for Streaming can only run with extraction mode Delta. In the most simple case, the chain is started every minute and looks for new data in the source. For many sources, it is possible that the source triggers the execution at the moment when new data is available.

Generating a Process Chain from a Data Flow

Generating a Process Chain from a Data Flow Object

Generating a process chain from a data flow object is a bit like using a sophisticated template to construct a detailed plan. This method is efficient, and it ensures that all necessary steps for data processing are comprehensively incorporated into your work-flow.

Suppose you have a complex data flow that needs to be managed and monitored. Instead of manually creating each step, there is a one-click option.

First, ensure that you have an active data flow object. This object serves as the basis for your process chain. Think of it as the blueprint from which your process chain will be constructed. Display the Data Flow Object. Click on the process chain icon and specify the name of the process chain. The system automatically opens SAP BW Bridge Cockpit, generates a process chain that includes processes such as data transfer, activation, and even data housekeeping, all tailored to the specifics of your data flow object. You can manually adjust the start condition , which was set to immediate, add or remove processes, or change their properties.

Launch the following video to learn how you generate a process chain from a Data Flow Object.

Conclusion

Generating a process chain from a data flow object is an example of how SAP Datasphere SAP BW Bridge streamlines and simplifies the complex world of data management.

Log in to track your progress & complete quizzes