Analyzing Distributed ImpEx

Objective

After completing this lesson, you will be able to compare the features of regular and distributed ImpEx.

Distributed ImpEx

ImpEx is well-suited to handling large volumes of data, but very large data sets can still slow it down. Distributed ImpEx solves this by delegating parts of the workload to other nodes in the SAP Commerce Cloud cluster, so imports run in parallel and complete faster.

In the following video, you will see what Distributed ImpEx is, how to enable it, and how it compares to regular ImpEx in practice.

Summary

  • Distributed ImpEx extends standard ImpEx to handle large imports by splitting them into batches processed in parallel across the cluster.
  • It runs in three phases - Prepare and Split, Single Task Execution, and Finish - and can be enabled from HAC, Backoffice, or the API.
  • Unlike regular ImpEx, it leverages the full cluster, uses one database transaction per batch, and can be aborted while running.