Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Bolo.

Table of Contents

Search

  1. Introducing Mass Ingestion
  2. Getting Started with Mass Ingestion
  3. Connectors and Connections
  4. Mass Ingestion Applications
  5. Mass Ingestion Databases
  6. Mass Ingestion Files
  7. Mass Ingestion Streaming
  8. Monitoring Mass Ingestion Jobs
  9. Asset Management
  10. Troubleshooting

Mass Ingestion

Mass Ingestion

Azure Event Hubs Kafka sources

Azure Event Hubs Kafka sources

You can configure a Kafka source to connect to Azure Event Hubs. To create an Azure Event Hubs Kafka source connection, use the Kafka connection type.
When you create a standard or dedicated tier Event Hubs namespace, the Kafka endpoint for the namespace is enabled by default. You can then use the Azure Event Hubs enabled Kafka connection as a source connection while configuring a streaming ingestion task. Enter the Event Hubs name as the topic name.
The Azure Event Hubs source information that you enter while configuring a streaming ingestion task is same as that of a normal Kafka source configuration. For more information about Azure Event Hubs Kafka source properties, see Azure Event Hubs Kafka source properties.
Configure the following properties while creating a Kafka connection in Administrator:
  • Kafka Broker List:
    NAMESPACENAME.servicebus.windows.net:9093
  • Additional Connection Properties:
    security.protocol=SASL_SSL,sasl.mechanism=PLAIN,sasl.kerberos.service.name=Kafka
  • SSL Mode: One-Way
  • SSL TrustStore File Path: Path to a trusted root cert on your file system. For example,
    <AGENT_HOME>/jdk/jre/lib/security/cacerts
  • SSL TrustStore Password: Trustore password.
  • Additional Security Properties:
    sasl.jaas.config= org.apache.kafka.common.security.plain.PlainLoginModule required username="$ConnectionString" password="Endpoint=sb://mynamespace.servicebus.windows.net/;SharedAccessKeyName=XXXXXX;SharedAccessKey=XXXXXX";
For more information about creating an Azure Event Hubs Kafka source connection, see the
Connections
help.
Event Hubs for Kafka is available only on standard and dedicated tiers. The basic tier doesn't support Kafka on Event Hubs.

0 COMMENTS

We’d like to hear from you!