Creating File Sweeps

Objective

After completing this lesson, you will be able to create a File Sweep process.

File Sweeps

File Sweep is a functionality that allows you to configure automated data integration from an FTP server. With this feature, after the data passes validation, the File Sweep processes, loads, and imports the data based on the configuration.

File Sweep functionality allows you to:

  • Have multiple FTP directory configurations for a single Import Format.
  • Configure each file record to be imported and posted.
  • Create file name pattern configurations so that a separate directory isn't required for each File Sweep configuration.
  • Create explicit sequencing of processing to control the order in which data is posted.
  • Configure In-File creation.
  • Configure In-Entity posting process to be triggered automatically based on a successful File Sweep.
  • Schedule the File Sweep.

Create a Simple File Sweep Process

Business Example:

In this exercise, you will configure a File Sweep to import records from an FTP server.

Steps

  1. Create the File Sweep record.

    1. In the Search field, enter File Sweep Search.

      The File Sweep Search screen.
    2. Choose + to add a new File Sweep record.

    3. On the File Sweep Detail screen, enter the File Sweep ID FileSweepCustomers

    4. Optionally, enter a comment in the Comments field to describe the details/purpose of the File Sweep.

    5. Leave the Invoke InEntityPost checkbox blank.

    6. Select Save.

  2. Configure the Import File (InFile).

    1. Choose (+) under InFile Configuration.

      Creating a new File Sweep. The Add icon is highlighted to add a new InFile configuration.
    2. Enter the following on the InFile Detail screen:

      • InFileCreation: Group all files under a single InFile
      • InFileIDPattern: ${FileSweepId}_${CurrentDate}_${CurrentTime}
      • Payout Type ID: CLIENT Payout
      • Leave the File Sweep InFile Mapper empty.
      • Select the AutoPost checkbox.
      • Select Save.
      The File Sweep InFile Detail screen is displayed, with details to an an InFile to a file sweep.
  3. Define the File Group.

    1. Choose + under File Groups.

    2. Enter the following in the File Sweep Group Detail popup:

      • Set the Import Format to TrainingCustomer.
      • Set the FTPServerNo to Client – File Sweep
      • In the FileNameFilter, enter Train.*\.xlsx.
      • Set the Removal Policy to Archive-FTP.
      • Set the FTPServerNoArchive to Client – File Sweep.
      • Leave the PGPEncrypted? box unchecked.
      • Set the Removal Policy Error to Do Nothing.
      The File Sweep File Group Detail screen.
    3. Select Save, then Activate.

    4. Close the popup window.

  4. Activate and save the File Sweep InFile detail.

    1. On the File Sweep InFile Detail popup, select Activate, then OK.

    2. Close the File Sweep InFile Detail popup.

    3. On the File Sweep Detail form, select Activate, then OK.

    4. Close the dialog box.

  5. Run the File Sweep manually.

    1. Select Run on the File Sweep Detail screen.

      • From the Manager portal, select Processing - File Sweep.
      • Select Run.
      • Review the File Sweep process.

Summary

  • File Sweep is a functionality that allows you to configure automated data integration from an FTP server.
  • Once the data passes validation, the File Sweep process loads and imports the data based on the configuration.
  • You can configure multiple FTP directory configurations.
  • File Sweeps can be scheduled.