Mass Ingestion

Back Next

Kafka target properties

The following table describes the Kafka target properties that on the

Target

tab when you define a

streaming ingestion

task:

Property	Description
Connection	Name of the Kafka target connection.
Connection Type	The Kafka connection type. The connection type populates automatically based on the connection that you select.
Topic Name/Expression	Kafka topic name or a Java supported regular expression for the Kafka topic name pattern. Use the $expression$ format for the regular expression. $expression$ evaluates the data and sends the matching data to capturing group 1. You can either enter the topic name manually or fetch the already created metadata of the Kafka connection. Click Select . The Select Target Object dialog box appears showing all the topics available in the Kafka broker. However, Kafka topic name patterns do not appear in the list. Select the required topic and click OK .

The following table describes the Kafka advanced target properties on the

Target

tab when you define a

streaming ingestion

task:

Property	Description
Producer Configuration Properties	The configuration properties for the producer.
Metadata Fetch Timeout in milliseconds	The time after which the metadata is not fetched.
Batch Flush Size in bytes	The batch size of the events after which a streaming ingestion task writes data to the target.