Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Rules and Guidelines for Snowflake Data Cloud file ingestion tasks

Rules and Guidelines for Snowflake Data Cloud file ingestion tasks

When you configure a file ingestion task to write to Snowflake Data Cloud from the supported file ingestion sources, you must specify a batch size for the maximum number of files to be transferred in a batch. Specify a value for the batch size in the required source properties of the file ingestion task. When you specify a batch size, the performance of the task is optimized.
The default batch size is 5. When you write from Amazon S3 or Azure Blob Storage sources to a Snowflake target, you can specify a maximum batch size of 1000 in the Amazon S3 or Azure Blob Storage source properties. For other file ingestion supported sources, you must specify a batch size between 1 and 20.

0 COMMENTS

We’d like to hear from you!