Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Deploying an application ingestion task

Deploying an application ingestion task

After you define an
application ingestion
task, deploy the task to create an executable job instance on the on-premises system that contains the Secure Agent and the Database Ingestion agent service. You can run an
application ingestion
job only after you deploy the associated task. When you deploy the task,
Mass Ingestion Applications
also validates the task definition.
If you undeploy a job and then want to run the job again, you must deploy the task again to create a new job instance. The new job instance name ends with an incremented number in the format
taskname
-
job_instance_number
. The job instance number is incremented each time you deploy the ingestion task by adding 1 to the maximum instance number across all ingestion jobs.
Before you deploy a task that is configured for a Snowflake target, you must drop the existing target tables that do not match the structure of source objects. The existing target tables might not match the structure of source objects because of newly added source fields, dropped source or target fields, or modified field null constraints or data types. When you deploy the task after dropping the existing target tables, a new set of target tables are generated based on the source object selection rules and target table renaming rules.
  1. To deploy a task, in the
    application ingestion
    task wizard, save the task and then click
    Deploy
    .
    If you included spaces in the name of the
    application ingestion
    task, the spaces are omitted from the name of the corresponding
    application ingestion
    job.
After you successfully deploy a task, an
application ingestion
job is created and the status of the job is Deployed. You can run the job from the
My Jobs
page in Mass Ingestion or from the
All Jobs
tab on the
Mass Ingestion
page in
Monitor
.
If the deployment fails, the status of the corresponding
application ingestion
job is Failed. To diagnose the error, you can download the error log from the
My Jobs
page in Mass Ingestion or from the
All Jobs
tab on the
Mass Ingestion
page in
Monitor
. To download the error log, on the
Actions
menu for the job, click
Error Log
. After you resolve the issue, deploy the task again from the
application ingestion
task wizard or from the
Actions
menu for the job.
  • If the Secure Agent is restarted while the task is deploying, the job status switches to Failed. Avoid restarting the Secure Agent while tasks are being deployed.
  • If a task appears to be hung in the Deploying state, restart the Secure Agent. The associated job instance acquires the status of Failed. You can then deploy it again.

0 COMMENTS

We’d like to hear from you!