Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Database Ingestion Agent environment variables

Database Ingestion Agent environment variables

To change or optimize the behavior of the Database Ingestion Agent, define the following environment variables:
Environment Variable
Description
DBMI_REPLACE_UNSUPPORTED_CHARS
For Microsoft Azure Synapse Analytics targets, controls whether an application ingestion job or database ingestion job replaces characters in character data that the target cannot process correctly. To enable character replacement, set this environment variable to true.
DBMI_REPLACE_UNSUPPORTED_CHARS=true
Mass Ingestion Applications
or
Mass Ingestion Databases
then uses the character that is specified in the DBMI_UNSUPPORTED_CHARS_REPLACEMENT environment variable to replace unsupported characters.
DBMI_UNSUPPORTED_CHARS_REPLACEMENT
If the DBMI_REPLACE_UNSUPPORTED_CHARS environment variable is set to true, specifies the character that replaces the characters in source data that a Microsoft Azure Synapse Analytics target cannot process correctly.
Default value: ? (question mark)
Define this environment variable only for
Mass Ingestion Databases
.
DBMI_WRITER_CONN_POOL_SIZE
Indicates the number of connections that an
application ingestion
job or
database ingestion
job uses to propagate the change data to the target. The default value is 8. Valid values are 4 through 8.
DBMI_WRITER_RETRIES_MAX_COUNT
If a network issue occurs while a
database ingestion
job is loading source data to an Amazon S3 or Microsoft Azure Data Lake Storage Gen2 target, indicates the maximum number of times that the
database ingestion
job retries a request to continue the initial load or incremental load. If all of the retries fail, the job fails.
The default value is 5.
DBMI_WRITER_RETRIES_INTERVAL_IN_MILLIS
Specifies the time interval, in milliseconds, that a
database ingestion
job waits before retrying the request to continue the initial load or incremental load to an Amazon S3 or Microsoft Azure Data Lake Storage Gen2 target if a network issue occurs.
The default value is 1000.
After you define or change an environment variable, restart the Database Ingestion Agent for the changes to take effect.

0 COMMENTS

We’d like to hear from you!