Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Google BigQuery V2 target properties

Google BigQuery V2 target properties

.
When you define a file ingestion task with a Google BigQuery V2 target, you must enter target options on the
Target
tab of the task wizard.
When you define a file ingestion task with a Google BigQuery V2 target, you can configure only Google Cloud Storage V2 as a source.
The following table describes the target options:
Option
Description
Target Table Name
Specify the Google BigQuery target table name.
Dataset ID
Specify the Google BigQuery dataset name.
Add Parameters
Create an expression to add it as
Target Table Name
and
Dataset ID
parameters. For more information, see Add Parameters.
Field Delimiter
Indicates whether Google BigQuery V2 Connector must allow field separators for the fields in a .csv file.
Quote Character
Specifies the quote character to skip when you write data to Google BigQuery. When you write data to Google BigQuery and the source table contains the specified quote character, the task fails. Change the quote character value to a value that does not exist in the source table.
Allow Quoted Newlines
Indicates whether Google BigQuery V2 Connector must allow the quoted data sections with newline character in a .csv file.
Allow Jagged Rows
Indicates whether Google BigQuery V2 Connector must accept the rows without trailing columns in a .csv file.
Skip Leading Rows
Specifies the number of top rows in the source file that Google BigQuery V2 Connector skips when loading the data.
The default value is 0.
Data format of the File
Specifies the data format of the source file. You can select one of the following data formats:
  • JSON (Newline Delimited)
  • CSV
  • Avro
  • Parquet
  • ORC
Write Disposition
Specifies how Google BigQuery V2 Connector must write data in bulk mode if the target table already exists.
You can select one of the following values:
  • Write Append. If the target table exists, Google BigQuery V2 Connector appends the data to the existing data in the table.
  • Write Truncate. If the target table exists, Google BigQuery V2 Connector overwrites the existing data in the table.
  • Write Empty. If the target table exists and contains data, Google BigQuery V2 Connector displays an error and does not write the data to the target. Google BigQuery V2 Connector writes the data to the target only if the target table does not contain any data.

0 COMMENTS

We’d like to hear from you!