Databricks Delta Connector

Back Next

Supported features for Microsoft Azure Data Lake Storage Gen2 source

When you configure pushdown optimization, the Microsoft Azure Data Lake Storage Gen2 connection supports the following properties:

Account Name

Client ID

Client Secret

Tenant ID

File System Name

Directory Path

Adls Gen2 End-point

Server-side Encryption

When you configure pushdown optimization, the mappings support the following properties for a Microsoft Azure Data Lake Storage Gen2 source:

Source connection, connection parameter

Source Type - Single, parameter

Format - Avro, Parquet, JSON, ORC, and CSV.

Intelligent Structure Model

Formatting Options

Filesystem Name Override

Source Type - File, Directory

Directory Override - Absolute path; Relative path

File Name Override - Source object

Allow Wildcard Characters

When you configure pushdown optimization, the mapping supports the following transformations:

Filter

Expression

Aggregator

Sorter

Router

Joiner

Lookup

Union

Rank

For information about the configurations for the listed options, see the help for the Microsoft Azure Data Lake Storage Gen2 Connector.