Creating Data Flows

Objective

After completing this lesson, you will be able to create data flows for the movement and transformation of data between sources and targets.

Data Services Data Flows

After creating a project and a job, the next step is to define a data flow to manage your data movement.

Watch the following video to learn how to configure and use data flows effectively.

A data flow defines the logic for moving and transforming data between a source and a target.

Diagram showing a flow from a source to a target going through some transformations.

The intermediate result generated at each step of the process is called a data set.

SAP Data Services Designer workspace showing a data flow with two query objects and highlighting the intermediate results between each step.

Summary

In this lesson, you learned about SAP Data Services data flows.

  • A data flow is a diagram that defines the complete Extract, Transform, and Load (ETL) process from source to target.
  • Connections between objects (sources, transforms, and targets) determine the specific order of data processing.
  • Each step in a flow produces a temporary data set that is passed to the next step for further processing.
  • Data flows are self-contained; temporary data created within a flow is not available to other parts of a workflow or job.
  • To make data available for other processes, you must load it into a permanent target, such as a database table or a flat file.