Architecture
The Privitar Connector is built with the following components:
Consumer will pull the records from Kafka.
Converter will deserialize binaries to a Kafka Connect data structure. This component is pluggable and could be any converter implementing the Kafka Connect API such as a StringConverter, AvroConverter or a JsonConverter.
Transforms is a chain of transformations which can transform any fields in the Kafka Connect data structure before the data is processed by the Privitar Sink Connector. These transformations are pluggable and could be any transform implementing the Kafka Connect API. This can help to transform the types such as transforming a timestamp or a string to a Java Date or to flatten the data structure.
The Privitar Connector will apply a Privitar Data Flow Job to the Record key and/or value. The Data Flow Job can be a Masking Data Flow Job or an UnMasking Data Flow Job.
Destination Transforms is a chain of transformation similar to the first one, but can be used to transform back the Java types to a serializable type after the data has been processed by the Privitar Connector. This can help to transform the Java types such as Date to a formatted date string.
Destination Converter will serialize the Kafka Connect data structure to binaries.
Producer will push the records to Kafka.