Name of the table in Microsoft Azure Synapse SQL to which the files are loaded.

Create an expression to add it as

Target Table Name

and

Schema

parameters. For more information, see Add Parameters.

The Microsoft Azure Synapse SQL schema name.

Truncate the target table before loading.

SQL command to run before the

file ingestion

task runs the PolyBase or Copy command.

SQL command to run after the

file ingestion

task runs the PolyBase or Copy command.

Character used to separate fields in the file. Default is 0x1e. You can select the following field delimiters from the list:

Specifies the quote character to skip when you write data to Microsoft Azure Synapse SQL. When you write data to Microsoft Azure Synapse SQL and the source table contains the specified quote character, the task fails. Change the quote character value to a value that does not exist in the source table.

Specifies the external stage directory to use for loading files into Microsoft Azure Synapse SQL. You can stage the files in Microsoft Azure Blob Storage or Microsoft Azure Data Lake Storage Gen2.

Determines whether or not files are compressed before they are transferred to the target directory.

None
. Files are not compressed.
GZIP
. Files are compressed using GZIP compression.

Number of concurrent connections to extract data from the Microsoft Azure Blob Storage or Microsoft Azure Data Lake Storage Gen2. When reading a large file or object, you can spawn multiple threads to process data. Configure

Blob Part Size

or

Block Size

to divide a large file into smaller parts.

Applies to Polybase ingestion method.

CREATE EXTERNAL FILE FORMAT {{fileFormatName}} WITH (FORMAT_TYPE = PARQUET)

Applies to Polybase ingestion method.

CREATE EXTERNAL TABLE {{externalTable}} (username VARCHAR(100),number int,colour VARCHAR(100))WITH (LOCATION='{{blobLocation}}',DATA_SOURCE={{dataSourceName}},FILE_FORMAT={{fileFormatName}})

Applies to Polybase ingestion method.

INSERT INTO testing.test_parq(username,number,colour) SELECT username, number,colour FROM {{externalTable}};

Applies to COPY Command ingestion method.

COPY INTO testing.test_parq FROM EXTERNALLOCATION WITH(CREDENTIAL = (AZURECREDENTIALS), FILE_TYPE = 'PARQUET')

SQL command to run before the

file ingestion

task runs the PolyBase command.

SQL command to run after the

file ingestion

task runs the PolyBase command.

Specifies the external stage directory to use for loading files into Microsoft Azure Synapse SQL. You can stage the files in Microsoft Azure Blob Storage or Microsoft Azure Data Lake Storage Gen2.

Number of concurrent connections to extract data from the Microsoft Azure Blob Storage or Microsoft Azure Data Lake Storage Gen2. When reading a large file or object, you can spawn multiple threads to process data. Configure

Blob Part Size

or

Block Size

to divide a large file into smaller parts.