Databricks Delta Connector

Back Next

Pushdown optimization using a Databricks Delta connection

You can configure pushdown optimization for a mapping that contains a Databricks Delta connection. Pushdown optimization enhances the mapping performance. You can configure full or source pushdown when you read data from a Databricks Delta source and write to a Databricks Delta target.

You can only configure pushdown optimization when you use the SQL warehouse to connect to Databricks Delta.

Databricks Delta pushdown optimization (SQL ELT)

Read from and write to Databricks Delta

Read from Amazon S3 and write to Databricks Delta

Read from Microsoft Azure Data Lake Storage Gen2 and write to Databricks Delta

Pushdown compatibility

Transformations with Databricks Delta

Features

Configuring a custom query for the Databricks Delta source object

Pushdown optimization for multiple targets

Single commit for pushdown optimization

Rules and guidelines for pushdown optimization