When I started at Vertica about seven years ago, I was met by anxious sales people warning me that Hadoop (HDFS, specifically) was going to completely replace the enterprise data warehouse (EDW), as we knew it. And we should be very concerned.
That was 2012, a year that I first encountered the lovable elephant and met swarms of Hadoop enthusiasts at a popular conference then called Strata Conference + Hadoop World in New York City.
Fast forward to today – Cloudera and Hortonworks have combined and HPE acquired MapR just before it closed up shop. And, O’Reilly still holds its annual Strata Data Conference – but there’s no mention of Hadoop in its billing. Needless to say, Hadoop did not replace the enterprise data warehouse. In fact, the EDW is alive and well and seeing yet another resurgence with the growing popularity and adoption of cloud data warehousing.
So, now, all enterprise data warehouses are moving to the cloud and all new analytical workloads will get spun up in the cloud. Right? I’m not falling for yet another over reaction to technology mega trends.
According to IDC, more than 70% of Big Data software revenues in 2019 will go toward on-premises solutions. And, Big Data software delivered via the public cloud will represent more than 44% of the total Big Data Analytics software opportunity 2022.
That said, there’s no denying that cloud-optimized architectures are dramatically changing the way that data-driven organizations manage and analyze increasing data volumes – particularly with separation of compute and storage architectures, cost-effective S3 storage, and the ability to isolate workloads in supporting multitenancy across organizations. If your organization wants to take advantage of all these capabilities, but can’t or aren’t ready to move to the clouds, then Vertica and Pure Storage have a path for you, too.
You have two primary options when it comes to Cloud data warehousing (CDW) – data warehouse as a service (DWaaS) or bring your own license (BYOL) to the clouds. But, what choice is right for your organization? As with all big decisions, the answer is “it depends.”
DWaaS is a popular choice, particularly for start-ups. It makes adoption simpler for business users who can often get up and running without IT involvement. However, many EDW features have been removed to provide that simpler user experience. On the other hand, BYOL data warehouses, like Vertica, provide organizations with complete flexibility to retain all of the essential EDW functionality, offer top analytical performance, and run on all major clouds, on-premises, in hybrid models, and even as a query engine to explore HDFS and S3 data lakes.
But, you’ll need to do your research before ultimately making the right decision for your organization. Or, you can just read the recently published Buyer’s Guide to Data Warehousing in the Cloud, from Enterprise Management Associates (EMA). Regardless of your decision, just make sure that you keep your future options open when the next technology mega trend comes our way.
Free Download: Buyer’s Guide to Data Warehousing in the Cloud
Free Download: GigaOm Enterprise Roadmap: Cloud Analytic Databases 2019
Free Download: Performance Benchmark: Vertica in Eon Mode and Snowflake
Free Download: Performance Benchmark: Vertica in Eon Mode and AWS Redshift
Web page: Vertica in the Clouds
Vertica Ranked #1 Cloud Data Warehouse
Is Data Warehouse as a Service Out for Your Blood?
How to Access Flexible Cloud-Optimized Analytics on AWS
Vertica Receives High Rankings in All Four Data Warehouse Use Cases in Gartner Critical Capabilities for Data Management Solutions for Analytics Report