You can configure full pushdown optimization to push a Lookup transformation to process in Databricks Delta. This applies to both connected and unconnected lookups.
You can add the following lookups:
Cached
Uncached
Unconnected with cached
When you configure a connected lookup, select the
Multiple Matches
property value as
Return all rows
in the lookup properties for pushdown optimization to work.
You can nest the unconnected lookup function with other expression functions.
When you configure an unconnected Lookup transformation, consider the following rules:
You must select the
Multiple Matches
property value as
Report error
in the unconnected lookup properties for pushdown optimization to work.
You can only configure an Expression transformation for an output received from an unconnected lookup.