Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introduction to Databricks Delta Connector
  2. Connections for Databricks Delta
  3. Mappings and mapping tasks with Databricks Delta connector
  4. Databricks Delta pushdown optimization (SQL ELT)
  5. Data type reference

Databricks Delta Connector

Databricks Delta Connector

Aggregator transformation

Aggregator transformation

You can configure full pushdown optimization to push an Aggregator transformation to process in Databricks Delta.

Aggregate calculations

You can perform the following aggregate calculations:
  • AVG
  • COUNT
  • FIRST
  • LAST
  • MAX
  • MIN
  • SUM
  • STDDEV
  • VARIANCE

Incoming ports

When you configure an Aggregator transformation and the incoming port is not used in an aggregate function or in a group by field, the output is not deterministic as the ANY_VALUE() function returns any value from the port.
You can pass only single arguments to the LAST, STDDEV, and VARIANCE functions.

0 COMMENTS

We’d like to hear from you!