Vertica

Author Archive

HP Vertica 7, Uniting and simplifying the worlds of data exploration and analysis

Today, we launched HP Vertica 7 “Crane,” our latest release of the HP Vertica Analytics Platform.  This release is a major milestone, as not only does it deliver exciting new platform enhancements, but it also marks HP Vertica’s entry into the data exploration space. In fact, we believe HP Vertica 7 will revolutionize many organizations’ approach to data exploration. With HP Vertica 7, we are providing the most open and comprehensive SQL-based solution to storing, exploring, and serving up big data deployments that span structured and, now, semi-structured data.

 

Here are some of the highlights:

 

Explore your data with HP Vertica Flex Zone

Our customers have shared many of their challenges with turning raw data into business insight. Data preparation, ETL, and schema creation are daunting tasks that prevent many of them from even considering analyzing some of their data sources. The rise in interest in “dark data” directly reflects the struggle businesses face in making use of new data sources that stream in terabytes of semi-structured information by the day, hour, and even minute.

crane-flex-table-05

That’s where HP Vertica Flex Zone comes in. We’ve combined the power of Vertica’s MPP columnar technology with some patent-pending approaches to managing semi-structured data to deliver the most flexible and extensible solution for SQL-based data exploration at a disruptive, introductory price. Imagine if you could collect data from many different sources, each having unique and varying structure, and without any major ETL work using your favorite BI tool to explore this otherwise unwieldy data set.  What untapped data might you explore? Or imagine promoting insights from your exploration directly to your operational reports with a single, simple step? How many more people in your organization could you empower? What if your business teams could ask new and different questions about these untapped data sources without requiring IT to rework and rerun costly ETL processes? How many more questions could your organization answer?  If this piques your interest then learn more about the new HP Vertica Flex Zone at our upcoming Webinar .

 

The best “SQL on Hadoop” just got better

We’ve provided integration with Hadoop for years and have built out one of the most extensive and open SQL on Hadoop offerings on the market. Our customers combine our integrations with MapReduce, Pig, and HDFS with features like external tables, user-defined loading, and our extensive SQL analytics to create integrated deployments of Hadoop and HP Vertica that address all aspects of the data analytics life cycle. With HP Vertica 7, we’ve made this offering even better by adding HCatalog integration, enabling Vertica installations to leverage the power of Hadoop’s table and storage management layer.  We’ve also improved security by implementing Kerberos authentication between Vertica and Hadoop. Now your SQL on Hadoop analytics can be even more feature rich as well as secure.

 

Hey DBAs: take a load off!

We know that the life of a DBA can be hard. You’re expected to manage and maintain the company’s key asset (its data!), ensure the highest SLAs, and respond quickly to evolving business needs. What you live for is even just a little time to sit back, relax, and let your data platform do the heavy lifting. Well with HP Vertica 7, we’re striving to make your lives easier. We’ve extended our workload management to give you better performance and control down to the CPU-core level, simplified our installer to better play with your favorite automation tools, and greatly improved our load times to ensure your large data loads are faster than ever. Go ahead, take a coffee break my DBA friend, we’ve got you covered.

 

Brew your own Java extensions

Every organization is different and one size does not fit all when it comes to big data. The HP Vertica Analytics Platform provides some great extensibility points that let our customers enhance the platform with user-defined functions, add rich in-database analytics in R, and even customize the loading process to handle data of their choosing. We’re now putting the power of extensibility into the hands of the Java programmer with our new Java SDK. Now, you can leverage those existing in-house Java skills and packages to customize, extend, and enrich your Vertica deployment.  How’s that for a tasty brew?

 

Oh yes, there’s more…

Beyond these highlights there is so much more that makes HP Vertica 7 our best release ever. We’ve improved performance, security and usability, simplified tuning and management operations, and even provided NoSQL-lovers a new way to query data. This release will satisfy the most demanding organizations looking for a total solution to their big data analytics needs.

 

For more details, check out the HP Vertica 7 release page and register for our upcoming webinar where we’ll be walking through all the key features and benefits. The Community version of HP Vertica 7 will soon be available for download from MyVertica, our community portal, so check back in and join the forum discussions. We look forward to hearing from you!

 

Luis Maldonado

Director of Product Management

HP Vertica

Now Shipping: HP Vertica Analytics Platform 6.1 “Bulldozer” Release

We’re pleased to announce that the “Bulldozer” (v6.1) release of the HP Vertica Analytics Platform is now shipping! The 6.1 release extends v6 of the HP Vertica Analytics Platform with exciting new enhancements that are sure to delight cloud computing and Hadoop fans alike, while giving data scientists and administrators more features and functionality to get the most out of their HP Vertica investment.

Tighter Hadoop Integration

With a name like “Bulldozer,” you’d expect the release to provide some heavy, big data lifting, and this release delivers. Many of our customers use Hadoop in early stages of their data pipeline, especially for storing loads of raw data. But after they’ve MapReduce-massaged the data, users want to load it into HP Vertica as fast as possible so they can start their true analytics processing. HP Vertica 6.1 provides a new HDFS connector that allows you to do just that: pull data straight from HDFS with optimal parallelism without any additional MapReduce coding. Furthermore, for users who are still deciding whether or not to bring some of their Hadoop data into their primary analytics window, they can use HP Vertica’s external tables feature with the HDFS connector to run rich analytics queries and functions in situ in HDFS. They may even choose to plug in a custom parser using the User Defined Load framework and let HP Vertica do some of the ETL lifting for them. Flexibility is what it’s all about, and to learn how to use the HP Vertica Analytics Platform with Hadoop, see our newly released white paper: Make All Your Information Matter — Hadoop and HP Vetica Analytics Platform.

Simplified Cloud Deployments

We also have many customers who run HP Vertica in the cloud, and know that more and more enterprises are making the cloud their deployment model of choice. To simplify and improve the cloud deployment experience, we now have an officially qualified Amazon EC2 AMI for HP Vertica. This AMI eliminates the guesswork and manual effort involved in rolling your own AMI. And to make these AMIs even easier to administer, we’ve provided cloud scripts that simplify the installation, configuration, and deployment of HP Vertica clusters. Now creating, expanding, and contracting your HP Vertica deployments is easier than ever, enabling a more agile and elastic cloud experience.

Killer Features for Big Data Analytics

In addition to the above, there are dozens of new features and improvements in this release that address the needs of Big Data analytics deployments. From a new R language pack that gets data scientists up and running quickly to enhanced storage tiering and archiving features that will help optimize storage media spend to new validation tools that assist administrators with hardware deployment planning and tuning, this new release provides the platform needed to create an enterprise-grade Big Data environment.  And, as with every release, we’ve made HP Vertica’s already incredibly fast performance even faster.

It’s easy for me to be excited about all the great new improvements in this release, but I challenge you to come see for yourself. Test drive HP Vertica 6.1 and find out how its new features can help you tackle your biggest Big Data challenges. Interested in learning more? Attend our upcoming Introduction to HP Vertica 6.1 webinar, where we’ll provide even more details about this exciting new release. We’re constantly striving to make the HP Vertica Analytics Platform the best solution for our customers’ Big Data analytics needs, and with our “Bulldozer” now out, the door we’re looking forward to helping more enterprises pave the way to data-driven business success.

 

Luis Maldonado

Director, HP Vertica

Introducing Vertica 6

by Shilpa Lawande & Luis Maldonado

Big data is all the rage these days.  It is incredible to watch this segment mature- even in just the past few years.  Of course, Vertica continues to evolve and innovate to keep up with the challenges and demands of this movement, especially when it comes to analytics.  The three greatest challenges customers face with regards to Big Data are 1) the volume and velocity of data, 2) the rapidly growing variety of disparate sources of data, and 3) the complex analytics that are required for maximizing the value of information derived from data.  In Vertica 6, we address all of these and more!

It has been just over two and a half years since Vertica first released FlexStore™, our patented architecture for flexible storage and placement of data based on usage patterns. During this time, we have been hard at work to evolve our flagship database product from a blazingly  fast database into a rich and flexible analytic platform.  Our high performance MPP columnar engine combined with our suite of built-in analytic functions including time-series, event-series pattern matching, C++ SDK, and more have enabled over 600 customers to transform their businesses by harnessing the power of large scale real-time analytics.  Last week at HP Discover, we raised the bar once again, with the release of Vertica 6, including the industry’s first and only open analytics architecture that enables broad analytics over any data source, structured, semi-structured or unstructured.

Let’s review some of the highlights of Vertica 6.

  • Vertica 6 FlexStore™ has been expanded to allow access to any data, stored at any location, via any interface, providing a comprehensive architecture to handle the requirements of Big Data – open, extensible, and flexible.  Using our patent-pending User-Defined Load (UDL) feature, you can now connect natively to popular storage systems like Hadoop File System (HDFS), existing databases and data warehouses, as well as unstructured analysis platforms such as HP/Autonomy IDOL™.  Further, by combining our External Tables capability with UDL, you can access those data sources in a federated manner at query time, without pre- loading data into Vertica. Now, whether you are just exploring your data in HDFS to find the right data model or building a production application, you can use the same robust Vertica SQL analytics you know and love, and use your favorite reporting and visualization tools to slice and dice the data!
  • Vertica 6 includes high performance and massively scalable in-database analytics for the R statistical tool.  Data scientists and analysts can now run their favorite statistical algorithms written in R natively and in parallel on Vertica, without the in-memory and single-threading limitations of R!  We’ve also expanded our C++ SDK to add secure sandboxing of user-defined code, and additional APIs for user-defined aggregates, analytics and multi-phase transform functions that can enable Map-Reduce style computations to be done in Vertica.
  • Vertica 6 simplifies the out-of-the-box user experience and enables more diverse workloads with our improvements to Workload Management.  An early adopter of Vertica 6 experienced a 40x speed up on some of their queries.  Whether you are running complex analytics or short operational BI workloads, Vertica’s workload management capabilities can effectively balance all system resources to meet your SLAs.
  • In 2007, Vertica was the first analytics platform to run on the Cloud. With Vertica 6 we extended this lead in significant ways. First, we announced a private beta of Vertica on HP’s new public Cloud. Further, we extended the core platform with a number of enhancements such as Object-level Backup & Restore and Schema evolution that make it much easier to develop and deploy multi-tenant applications using Vertica.
  • Last but not the least, we continue to invest in our core platform with a  number of enhancements to overall query and load performance, elastic cluster, monitoring views, database designer, security and more.

For a quick overview of Vertica 6, we highly recommend watching this video interview of Luis Maldonado, Director of Product Management, from last week’s HP Discover show, or reading What’s new in Vertica 6 Enterprise Edition.  Watch this space over the next few days, for more articles that drill down into specific features of Vertica 6!

We at Vertica are very excited about Vertica 6 and the role it plays in HP’s vision for Cloud, Security and Information Optimization.  We hope you will try it for yourselves and tell us your stories about how you used it to Make it Matter for your business!

Over the next few days, watch this space for articles that drill down into specific features of Vertica 6.

Get Started With Vertica Today

Subscribe to Vertica