Data Ingestion and Replication
- Data Ingestion and Replication
- All Products
Option
| Description
|
---|---|
File Pattern
| File name pattern to use for selecting the files to transfer. The pattern can be a regular expression or a pattern with wildcard characters.
The following wildcard characters are allowed:
For example, you can specify the following regular expression:
([a-zA-Z0-9\s_\\.\-\(\):])+(.doc|.docx|.pdf)$
|
File Date
| A date and time expression for filtering the files to transfer.
Select one of the following options:
For example, if you schedule the
file ingestion task to run weekly and want to filter for the files that were modified in the previous week, set
Days before today to 7. The task will pick up any file with a date between 7 days ago and the date on which it runs.
|
Time Zone
| If you selected a
File Date option, enter the time zone of the location where the files are located.
|
File Size
| Filters the files to transfer based on file size. Enter the file size, select the file size unit, and filter options.
Select one of the following filter options:
|
Skip Duplicate Files
| Indicates whether to skip duplicate files. If you select this option, the file ingestion task does not transfer files that have the same name and creation date as another file. The file ingestion task marks these files as duplicate in the job log. If you do not select this option, the task transfers all files, even files with duplicate names and creation dates.
|
Batch Size
| The number of files a
file ingestion task can transfer in a batch.
Default is 5.
|
After File Pickup
| Determines what to do with the source files after the files are transferred.
Select one of the following filter options:
|