Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Microsoft Azure Data Lake Storage Gen2 connection properties

Microsoft Azure Data Lake Storage Gen2 connection properties

When you set up a Microsoft Azure Data Lake Storage Gen2 connection, you must configure the connection properties.
The following table describes the Microsoft Azure Data Lake Storage Gen2 connection properties:
Connection property
Description
Connection Name
Name of the connection.
The name is not case sensitive. It must be unique within the domain. You can change this property after you create the connection. The name cannot exceed 128 characters, contain spaces, or contain the following special characters:
~ ` ! $ % ^ & * ( ) - + = { [ } ] | \ : ; " ' < , > . ? /
Description
Optional. Description that you use to identity the connection.
The description cannot exceed 765 characters.
Type
The Microsoft Azure Data Lake Storage Gen2 connection type.
Runtime Environment
Name of the runtime environment where you want to run the tasks.
You cannot run a database ingestion or streaming ingestion task on a Hosted Agent or serverless runtime environment.
Account Name
Microsoft Azure Data Lake Storage Gen2 account name or the service name.
Authentication Type
Authentication type to access the Microsoft Azure Data Lake Storage Gen2 account.
Select one of the following options:
  • Service Principal Authentication
    . Select to use the client ID, client secret, and tenant ID to connect to Microsoft Azure Data Lake Storage Gen2.
  • Shared Key Authentication
    . Select to use the account key to connect to Microsoft Azure Data Lake Storage Gen2.
  • Managed Identity Authentication
    . Select to authenticate using identities that are assigned to applications in Azure to access Azure resources in Microsoft Azure Data Lake Storage Gen2.
Mass Ingestion Applications
and
Mass Ingestion Streaming
do not support shared key authentication or managed identity authentication.
Client ID
Applies to Service Principal Authentication and Managed Identity Authentication.
To use service principal authentication, specify the application ID or client ID for your application registered in the Azure Active Directory.
To use managed identity authentication, specify the client ID for the user-assigned managed identity. If the managed identity is system-assigned, leave the field empty.
Client Secret
Applies to Service Principal Authentication.
The client secret key to complete the OAuth authentication in the Azure Active Directory.
Tenant ID
Applies to Service Principal Authentication.
The directory ID of the Azure Active Directory.
Account Key
Applies to Shared Key Authentication.
The account key for the Microsoft Azure Data Lake Storage Gen2 account.
File System Name
The name of an existing file system in the Microsoft Azure Data Lake Storage Gen2 account.
Directory Path
The path of an existing directory without the file system name.
You can select one of the following syntax:
  • /
    for root directory.
  • /dir1
  • dir1/dir2
There is no default directory.
Adls Gen2 End-point
The type of Microsoft Azure endpoints.
You can choose one of the following endpoints:
  • core.windows.net
    . Default
  • core.usgovcloudapi.net
    . To select the Azure Government endpoints.
For more information about creating a client ID and a client secret, see
Microsoft Azure Data Lake Storage Gen2 documentation
.

0 COMMENTS

We’d like to hear from you!