Apache Kafka Integration
This section contains information on updates to Kafka-integration information for Vertica Analytic Database 8.1.x.
Execution Parallelism
You can specify the executionparallelism parameter in the KafkaSource UDL. By default, Vertica automatically creates a thread for every partition. You can use this parameter to throttle the number of threads used to process any COPY statement.
Schema Registry Support
Vertica supports the use of a Confluent schema registry with the KafkaAVROParser. By using a schema registry, you enable the Avro parser to parse and decode messages written by the registry and to retrieve schemas stored in the registry. In addition, a schema registry enables Vertica to process streamed data without sending a copy of the schema with each record.
SSL Support
Vertica supports SSL connections between the scheduler, Vertica and Kafka.
More Details
For more information see Integrating with Apache Kafka .