Vertica Blog

Vertica Blog

Kafka

Data Lakehouse

Going Beyond a Data Lakehouse

David Sprogis, Director of Product Management
December 15, 2021

The way things get named in this industry can be pretty odd.  A lot of people have been hearing noise about how cool a “Data Lakehouse” is since it combines the power of a data lake with the power of a data warehouse. When I think of a lakehouse, I think of a great place...

Take Nothing but Memories. Leave Nothing but Footprints

Mark Whalley, Manager, Vertica Education
August 25, 2020

For those who have read my previous blog postings, attended one of our Big Data & Machine Learning Meetups, or have met me at one of the many trade shows or conferences over the years, you will be all too aware of my love for tracking aircraft using a Raspberry Pi, Kafka and Vertica. For...
The Earth

“awk” sed Grep, “whoami?”. Time CC if bash makes head or tail and sort > plain.txt and make us API

Mark Whalley, Manager, Vertica Education
July 13, 2020

Things to do whilst confined to barracks due to COVID-19 For those who know me well, having worked in IT for four decades, will know that I can be a bit of a Luddite when it comes to new-fangled technology. Give me a character-based, green-screen PuTTY application over any pointy-clicky interface.  Let me use vsql...
Heavy rocket blasting above the clouds

Vertica Version 10 Launches Today!

Paige Roberts, Vertica Open Source Relations Manager
March 31, 2020

There’s big news today, on the first day of the Virtual Vertica Big Data Conference 2020 – a major new version of Vertica blasts off! Vertica version 10 soars straight into the greatest deployment flexibility of any analytical data warehouse on the market. This fast and extremely scalable platform gives you more power than ever...
Flight Tracking

Pennard, We Have a Problem – Troubleshooting Flight Tracking with the Grafana Plugin for Vertica

Mark Whalley, Manager, Vertica Education
February 26, 2020

With Vertica’s Management Console, I have everything I need at my fingertips to manage and monitor my Vertica clusters and databases.  Whether that be investigating query performance issues, checking on the health of the cluster’s nodes, running the Database Designer or marveling at the volume of data being ingested by the Vertica Scheduler from a...
Larry Bird Monument - Photo by Eric Kilby WC

Practice Makes Perfect at BDC 2020

Jeff Healey, Sr Director, Vertica Product Marketing at Micro Focus
February 19, 2020

Larry Bird, Boston Celtics legend and NBA Hall of Famer, shot 500 free throws every morning before his first class in high school. But, he didn’t stop there. Larry was known to shoot 100 free throws after every NBA game. The result? The sharp-shooting forward from French Lick, Indiana led the NBA in free throw...
Planets in solar system

The Kafka Convergence

Paige Roberts, Vertica Open Source Relations Manager
January 20, 2020

Apache Kafka seems to be everywhere these days. I’m feeling a bit surrounded by Kafka right now, in fact, like I’m at the center of a convergence of the planets, and data flowing through Kafka is the gravitational pull. Let me give you an idea of what I mean. So, Vertica just announced the release...

Streaming Data in One Line!

Bryan Herger, Vertica Big Data Solution Architect at Micro Focus
July 31, 2019

Remember that game show, "Name That Tune", where contestants were challenged to name a tune in as few notes as possible? Today's tip converts that for Vertica Big Data, showing how we can ingest streaming data in just one line! A simple way to stream data is to write CSV rows to a network socket....

See You at IoT World Conference Next Month

Ben, Senior Product Marketing Manager
April 25, 2019

Are you attending the IoT World Conference in Santa Clara from May 13-16th? Come by booth #1254 to hear why more and more companies, including medical device manufacturers, wearable product developers, network service providers, and manufacturing intelligence software companies, are turning to Vertica to manage their growing volumes of IoT data. Vertica is purpose-built for...
Commercial passenger plane with Vertica painted on the tail

Blog Post Series: Using Vertica to Track Commercial Aircraft in near Real-Time — Part 7

Mark Whalley, Manager, Vertica Education
April 4, 2019

Preparing Vertica to consume messages from Kafka How time has flown (no pun intended!).  At long last getting back to continuing this project on tracking commercial aircraft… Having covered ADS-B, the Raspberry Pi, DUMP1090, Zookeeper and Kafka and then in the previous blog post, how to develop an Extract, Transform and Load (ETL) application to...

Why is Vertica not Ingesting Data From Kafka?

Soniya Shah, Information Developer
June 14, 2018

Prerequisite: Verify that Vertica is up and running. If you want to troubleshoot why Vertica is not ingesting data from Kafka, follow this checklist. Step Task Results 1 Check whether Kafka is up and running. a. Examine the server log files for broker errors: If there are errors, consult the Kafka documentation. b. Examine the...

Handling Duplicate Records in Input Data Streams

Soniya Shah, Information Developer
April 17, 2018

This blog post was authored by Ravi Gupta. We have often found that sources or operational systems that provide data for further analysis have duplicate records and these are sent to a downstream application or EDW for processing. This post shows a few scenarios of how to handle these duplicate records using various SQL options,...