Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Microsoft Azure Synapse SQL connection properties

Microsoft Azure Synapse SQL connection properties

When you set up a Microsoft Azure Synapse SQL connection, you must configure the connection properties.
The following table describes the Microsoft Azure Synapse SQL connection properties:
Connection property
Description
Runtime Environment
The name of the runtime environment where you want to run the tasks.
Select a Secure Agent, Hosted Agent, or serverless runtime environment.
Azure DW JDBC URL
Microsoft Azure Synapse SQL JDBC connection string.
Example for Microsoft SQL Server authentication:
jdbc:sqlserver://<Server>.database.windows.net:1433;database=<Database>
Example for Azure Active Directory (AAD) authentication:
jdbc:sqlserver://<Server>.database.windows.net:1433; database=<Database>;encrypt=true;trustServerCertificate=false; hostNameInCertificate=*.database.windows.net;loginTimeout=30; Authentication=ActiveDirectoryPassword;
The default authentication is Microsoft SQL Server authentication.
Azure DW JDBC Username
User name to connect to the Microsoft Azure Synapse SQL account. Provide AAD user name for AAD authentication.
Azure DW JDBC Password
Password to connect to the Microsoft Azure Synapse SQL account.
Azure DW Schema Name
Name of the schema in Microsoft Azure Synapse SQL.
Azure Storage Type
Type of Azure storage to stage the files. You can select any of the following storage type:
  • Azure Blob. Default. To use Microsoft Azure Blob Storage to stage the files.
  • ADLS Gen2. To use Microsoft Azure Data Lake Storage Gen2 as storage to stage the files.
Authentication Type
Authentication type to connect to Azure storage to stage the files.
Select one of the following options:
  • Shared Key Authentication
    . Select to use the account name and account key to connect to Microsoft Azure Blob Storage or Microsoft Azure Data Lake Storage Gen2.
  • Service Principal Authentication
    . Applies to Microsoft Azure Data Lake Storage Gen2. To use Service Principal authentication, you must register an application in the Azure Active Directory, generate a client secret, and then assign the Storage Blob Contributor role to the application
  • Managed Identity Authentication
    . Applies to Microsoft Azure Data Lake Storage Gen2. Select to authenticate using identities that are assigned to applications in Azure to access Azure resources in Microsoft Azure Data Lake Storage Gen2.
    In a file ingestion task, if you select Microsoft Azure Synapse SQL with Managed Identity authentication type as the target, then you must select Microsoft Azure Data Lake Storage Gen2 as the source.
Azure Blob Account Name
Applies to Shared Key Authentication for Microsoft Azure Blob Storage.
Name of the Microsoft Azure Blob Storage account to stage the files.
Azure Blob Account Key
Applies to Shared Key Authentication for Microsoft Azure Blob Storage.
Microsoft Azure Blob Storage access key to stage the files.
ADLS Gen2 Storage Account Name
Applies to Shared Key Authentication and Service Principal Authentication for Microsoft Azure Data Lake Storage Gen2.
Name of the Microsoft Azure Data Lake Storage Gen2 account to stage the files.
ADLS Gen2 Account Key
Applies to Shared Key Authentication for Microsoft Azure Data Lake Storage Gen2.
Microsoft Azure Data Lake Storage Gen2 access key to stage the files.
Client ID
Applies to Service Principal Authentication
and Managed Identity Authentication
for Microsoft Azure Data Lake Storage Gen2.
To use service principal authentication, specify the application ID or client ID for your application registered in the Azure Active Directory.
To use managed identity authentication, specify the client ID for the user-assigned managed identity. If the managed identity is system-assigned, leave the field empty.
Client Secret
Applies to Service Principal Authentication for Microsoft Azure Data Lake Storage Gen2.
The client secret for your application.
Tenant ID
Applies to Service Principal Authentication for Microsoft Azure Data Lake Storage Gen2.
The directory ID or tenant ID for your application.
Blob End-point
Type of Microsoft Azure endpoints.
You can select one of the following endpoints:
  • core.windows.net
    . Default.
  • core.usgovcloudapi.net
    . To select the Azure Government endpoints.
VNet Rule
Enable to connect to a Microsoft Azure Synapse SQL endpoint residing in a virtual network (VNet).
When you use a serverless runtime environment, you cannot connect to a Microsoft Azure Synapse SQL endpoint residing in a virtual network.

0 COMMENTS

We’d like to hear from you!