Apache Kafka Integration

This section contains information on updates to Kafka-integration information for Vertica Analytic Database 8.1.x.

Execution Parallelism

You can specify the executionparallelism parameter in the KafkaSource UDL. By default, Vertica automatically creates a thread for every partition. You can use this parameter to throttle the number of threads used to process any COPY statement.

Schema Registry Support

Vertica supports the use of a Confluent schema registry with the KafkaAVROParser. By using a schema registry, you enable the Avro parser to parse and decode messages written by the registry and to retrieve schemas stored in the registry. In addition, a schema registry enables Vertica to process streamed data without sending a copy of the schema with each record.

SSL Support

Vertica supports SSL connections between the scheduler, Vertica and Kafka.

More Details

For more information see Integrating with Apache Kafka .