Vertica Blog

Vertica Blog

Under the Hood

Improving Performance and Memory Acquisitions for Vertica Queries

This blog post was authored by Shrirang Kamat. The following design considerations will help you improve the performance and memory of your Vertica queries. When creating table definitions, you should carefully choose the size of the lookup column based on your data. Properly sizing your column based on your data will help to improve performance....
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time – Part 6

Part 6: Extract, Transform and Load ADS-B messages into Kafka I have discussed in previous blog posts the continuous stream of messages from aircraft transponders, captured and decoded using the DUMP1090 application, which we are planning on feeding into a series of Kafka topics, prior to loading into their corresponding tables in a Vertica database....

Projection Delete Concerns

This blog post was authored by Curtis Bennett. Deletes in Vertica are a complicated topic. I’ve had many people say to me that they’d heard that one should never do deletes in Vertica, or that deletes in Vertica are slow. Nothing could be further from the truth. But like anything in a database, they should...

Monitoring Login Failures

This blog post was authored by Curtis Bennett. Security is an ever-present topic on the minds of database administrators. Certainly Vertica has a number of security features like Kerberos, and SSL. This blog isn’t about those! Instead, let’s take a look at a much more simplistic aspect of security which Vertica tracks – login failures....
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 5

Part Five: Apache Kafka As discussed in an earlier blog post, we have a continuous stream of messages from aircraft transponders captured and decoded using the DUMP1090 application. We now want to load this data into a series of Vertica tables. As with the streaming nature of the incoming data, with many 10s, possibly 100s...
Programmer

Operational Considerations for Database Administrators in Eon Mode

This blog post was authored by Shrirang Kamat. The purpose of this document is to familiarize advanced Vertica Enterprise mode users about some of the behavioral similarities and differences between Vertica Enterprise mode and Vertica Eon mode. This document assumes you have a basic understanding about Eon mode architecture. You can find more details about...

Vertica Eon Mode: Caching

This blog post was co-authored by Pratibha Rana and Ben Vandiver. Running every query directly against the data in shared storage would result in poor performance and subject the shared storage to heavy load. Eon mode in Vertica introduces a cache called the Depot that avoids reading from the shared storage for frequently used data...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 4

Part Four: Installing DUMP1090 to decode ADS-B messages The preceding blog post detailed the hardware requirements used in this project for tracking commercial aircraft in near real-time. In this blog post I will touch on installing the operating system on the Raspberry Pi (RPI) and the DUMP1090 software used for decoding the ADS-B signals being...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 3

Building a Raspberry Pi to Capture ADS-B signals Picking apples, pears, blackberries or raspberries In a previous blog post, I provided a very high-level overview of ADS-B, and that with the appropriate pieces of hardware and some open-source software, it was possible to capture and decode the radio signals being broadcast from commercial aircraft, with...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real Time –Part 2

Part Two: Automatic Dependent Surveillance - Broadcast (ADS-B) A Source of Streaming Data If you're joining us a new reader, be sure to read part one of this series to get up to speed! When looking for a topic to use in the first of The Lab Series’ mini projects for the Big Data and...

IoT Analytics with Open Source and Vertica – Tracking Commercial Aircraft in near Real Time — Part 1

Project Overview This post presents an overview of an ongoing series that focuses on using Vertica, Raspberry Pi, and Apache Kafka to track commercial aircraft in near-real time. Often, people try to understand how to do IoT data analytics with their tool of choice, such as Vertica. Doing so can present some difficulty, especially if...

Use MERGE to Update 1 Million Rows in 2 Seconds

This blog post was co-authored by Yassine Faihe, Michael Flower, and Moshe Goldberg. Updating One Million Records in Two Seconds To illustrate the true power of MERGE, this article describes how we used MERGE to demonstrate Vertica's performance at scale. SQL MERGE statements combine INSERT and UPDATE operations. They are a great way to update...