Analytics & Data Science by Dataiku London

About the Event

Meetup

First Talk:
Getting the Data: Tracking commercial aircraft in near real-time using a Raspberry Pi, Kafka & Vertica

Using relatively simple to acquire hardware and software, this presentation shows how it possible to track the flights of commercial aircraft in near real-time. Automatic Dependent Surveillance Broadcast (ADS-B) data from aircraft transponders is captured and decoded using a Raspberry Pi, delivered through a series of Apache Kafka Topics before being loaded into a Vertica database.

With real-time streaming combined with billions of rows of historical data, we look at how this can be manipulated and used with relative ease using the inbuilt analytics and machine learning capabilities of Vertica for data capture, enrichment, measuring and preparing. Demonstrating examples of simple SQL functions for handling time series data, gap filling and interpolation and outlier detection.