Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

File listener source properties

File listener source properties

Configure a file listener as a source type when you use the file listener to trigger the
file ingestion
task.
To configure a file listener as a source, you must create a file listener by using the Components service. For more information about creating a file listener, see the
Components
help.
You cannot run the
file ingestion
task with a file listener as a source from the
file ingestion
user interface. A
file ingestion
task with a file listener as a source runs automatically when the file listener starts.
The following table describes the source options:
Option
Description
File Pattern
File name pattern to use for selecting the files to transfer. The pattern can be a regular expression or a pattern with wildcard characters.
The following wildcard characters are allowed:
  • An asterisk (*) to represent any number of characters.
  • A question mark (?) to represent a single character.
For example, you can specify the following regular expression:
([a-zA-Z0-9\s_\\.\-\(\):])+(.doc|.docx|.pdf)$
File Date
A date and time expression for filtering the files to transfer.
Select one of the following options:
  • Greater than or Equal
    . Filters files that are modified on or after the specified date and time.
    To specify a date, click the calendar. To specify a time, click the clock.
  • Less than or Equal
    . Filters files that are modified before or on the specified date and time.
  • Equal
    . Filters files that are modified on the specified date and time.
    Click the calendar to select the date and the clock to select the time.
  • Days before today
    . Filters files that are modified within the specified number of days until the current date (today). Enter the number of days. The current date calculation starts from 00:00 hours.
For example, if you schedule the
file ingestion
task to run weekly and want to filter for the files that were modified in the previous week, set
Days before today
to 7. The task will pick up any file with a date between 7 days ago and the date on which it runs.
Time Zone
If you selected a
File Date
option, enter the time zone of the location where the files are located.
File Size
Filters the files to transfer based on file size. Enter the file size, select the file size unit, and filter options.
Select one of the following filter options:
  • Greater than or Equal
    . Filters files that are greater than or equal to the specified size.
  • Less than or Equal
    . Filters files that are less than or equal to the specified size.
  • Equal
    . Filters files that have the specified size.
Skip Duplicate Files
Indicates whether to skip duplicate files. If you select this option, the file ingestion task does not transfer files that have the same name and creation date as another file. The file ingestion task marks these files as duplicate in the job log. If you do not select this option, the task transfers all files, even files with duplicate names and creation dates.
Batch Size
The number of files a
file ingestion
task can transfer in a batch.
Default is 5.
After File Pickup
Determines what to do with the source files after the files are transferred.
Select one of the following filter options:
  • Keep the files in the source directory.
  • Delete the files from the source directory.
  • Rename the files in the source directory. You must specify a file name suffix that
    file ingestion
    task adds to the file name when renaming the files.
  • Archive the files to a different location. You must specify an archive directory.

0 COMMENTS

We’d like to hear from you!