Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introduction to Databricks Delta Connector
  2. Connections for Databricks Delta
  3. Mappings and mapping tasks with Databricks Delta connector
  4. Databricks Delta pushdown optimization (SQL ELT)
  5. Data type reference

Databricks Delta Connector

Databricks Delta Connector

Pushdown optimization preview

Pushdown optimization preview

Before you can run a mapping task configured for pushdown optimization, you can preview if pushdown optimization is possible when you create the mapping. You can preview pushdown optimization from the
Pushdown Optimization
panel in the Mapping Designer.
After you select the required pushdown optimization options and run the preview,
Data Integration
creates and runs a temporary pushdown preview mapping task. When the job completes,
Data Integration
displays the SQL queries to be executed and any warnings in the
Pushdown Optimization
panel. The warning messages help you understand which transformations in the configured mapping are not applicable for pushdown optimization. If pushdown optimization fails, Data Integration lists any queries generated up to the point of failure. You can edit the mapping and fix the required transformations before you run the mapping for pushdown optimization.
You can also view the temporary job created under
My Jobs
and download the session log to view the queries generated.
For more information about how to preview pushdown optimization, see the topic "Pushdown optimization preview" in
Mappings
in the Data Integration help.

0 COMMENTS

We’d like to hear from you!