How Vertica and Data Streaming Work Together

Vertica provides a high-performance mechanism for streaming data both to and from third party message buses. Data streaming provides high volumes of data with low latency.

This feature lets you:

• Store and analyze data that is generated by any application that writes to the message bus. With a message bus, you do not need to worry about individually configuring each application to connect to Vertica.
• Send Vertica data to any application that can read from the message bus. There are two types of data you can send to a data bus:
  • Vertica tables and results of queries. This feature lets you export the results of Vertica analytics to any other application connected to the message bus.
  • Data from Vertica's Data Collector tables. You can use this data to monitor your Vertica database's performance and health via third-party monitoring tools.

Because Vertica can both receive and send data to a streaming message bus, you can use it as part of an automated analytics workflow. Vertica can retrieve data from the message bus, perform analytics on it, and then send the results back to the message bus for consumption by other applications.

Common Uses of Data Streaming with Vertica

There are many cases where you could use Vertica to process data from a streaming data source. This document will use the following two cases as examples:

• Retrieving and processing data from an e-commerce site. This includes raw access logs from a web server farm, clickstream data generated by a JavaScript-based Web 2.0 interface, and even back-end fulfillment processing.
• An Internet of Things (IOT) network where device sensor data is sent from many individual devices to the message bus via web API calls.