Vertica Blog

Vertica Blog

IoT

Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 7

Preparing Vertica to consume messages from Kafka How time has flown (no pun intended!).  At long last getting back to continuing this project on tracking commercial aircraft… Having covered ADS-B, the Raspberry Pi, DUMP1090, Zookeeper and Kafka and then in the previous blog post, how to develop an Extract, Transform and Load (ETL) application to...
Big Data sign next to cute baby yellow elephant

Big Data – Big Asset or Big Liability

The newly converged Cloudera recently announced its quarterly earnings and the market was very disappointed, resulting in a stock price drop of 42% and a lot of negative media coverage. One headline that stuck out to me read: “Does Cloudera’s Stock Drop Signal the End of Big Data?” I thought, “No, I don’t think Cloudera’s...
House diagram showing sensors for lights, weather, security, internal temp, etc.

The Internet of Things (IoT) and Smart Metering

Every month, my husband receives a driver’s report from Chevrolet, providing him with “feedback” on his driving behavior – everything from the intensity of his braking to the number of lane changes without a blinker to the distance and speed he drove in his Silverado truck. The report also provides specific details on the upcoming...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time – Part 6

Part 6: Extract, Transform and Load ADS-B messages into Kafka I have discussed in previous blog posts the continuous stream of messages from aircraft transponders, captured and decoded using the DUMP1090 application, which we are planning on feeding into a series of Kafka topics, prior to loading into their corresponding tables in a Vertica database....
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 5

Part Five: Apache Kafka As discussed in an earlier blog post, we have a continuous stream of messages from aircraft transponders captured and decoded using the DUMP1090 application. We now want to load this data into a series of Vertica tables. As with the streaming nature of the incoming data, with many 10s, possibly 100s...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 4

Part Four: Installing DUMP1090 to decode ADS-B messages The preceding blog post detailed the hardware requirements used in this project for tracking commercial aircraft in near real-time. In this blog post I will touch on installing the operating system on the Raspberry Pi (RPI) and the DUMP1090 software used for decoding the ADS-B signals being...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 3

Building a Raspberry Pi to Capture ADS-B signals Picking apples, pears, blackberries or raspberries In a previous blog post, I provided a very high-level overview of ADS-B, and that with the appropriate pieces of hardware and some open-source software, it was possible to capture and decode the radio signals being broadcast from commercial aircraft, with...

IoT Data and AI Summit

Previously known as IoT Data Analytics & Visualization, the IoT Data & AI Summit is the first dedicated event to bringing the value of Artificial Intelligence and IoT together. During the event, join technical sessions exploring IoT Data and AI technologies and network with a targeted audience to make high quality, relevant connections. This focused...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real Time –Part 2

Part Two: Automatic Dependent Surveillance - Broadcast (ADS-B) A Source of Streaming Data If you're joining us a new reader, be sure to read part one of this series to get up to speed! When looking for a topic to use in the first of The Lab Series’ mini projects for the Big Data and...

CIO Forum – New York

Attending CIO Forum this year? Come see

IoT Analytics with Open Source and Vertica – Tracking Commercial Aircraft in near Real Time — Part 1

Project Overview This post presents an overview of an ongoing series that focuses on using Vertica, Raspberry Pi, and Apache Kafka to track commercial aircraft in near-real time. Often, people try to understand how to do IoT data analytics with their tool of choice, such as Vertica. Doing so can present some difficulty, especially if...