Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Mass Ingestion Files source types

Mass Ingestion Files
source types

You can transfer files from on-premises and cloud sources that
Mass Ingestion Files
support to supported targets.
You can add a source to a
file ingestion
task in the following ways:
Through data catalog discovery
If your organization administrator has configured Enterprise Data Catalog integration properties, you can perform data catalog discovery to find the source object in the catalog. You can discover Amazon S3 V2, Microsoft Azure Blob Storage V3, or Hadoop Files V2 objects to use as sources in new
file ingestion
tasks.
Search for the source object on the
Data Catalog
page, select the object in the search results, and then add it to a new
file ingestion
task.
When you configure the task
Select the source connection and source object on the
Source
tab when you configure the
file ingestion
task.
Mass Ingestion Files
supports the following source types:
  • Source Connection— Supports the following sources:
    • Local folder
    • Advanced FTP V2
    • Advanced FTPS V2
    • Advanced SFTP V2
    • Amazon S3 V2
    • Google Cloud Storage V2
    • Hadoop Files V2
    • Microsoft Azure Blob Storage V3
    • Microsoft Azure Data Lake Store Gen2
    • Microsoft Azure Data Lake Store V3
    • Databricks Delta
  • File Listener— Use a file listener component as a source.
To determine the connectors to use for these source types, see
Connectors and Connections
>
Mass Ingestion Files connectors
.
For more information, see Configuring the source.

0 COMMENTS

We’d like to hear from you!