Syncsort, a global leader in data integration, data protection and high-speed sorting software, Vertica Systems, the market innovator for high-performance analytic database management systems, and HP, the world’s largest technology company, have set a new world record for loading data into a relational database for business intelligence applications. This new world record meets the growing need for faster loading speed while empowering enterprises to rapidly integrate data from disparate sources. With data warehouses dramatically increasing in size, this achievement enables companies to accelerate ROI and make better and more timely business decisions.

5.4TB Loaded and ready to be Analyzed in less than an Hour

This new world record shatters the previous extraction, transformation and load (ETL) performance benchmark, held by Microsoft and Unisys. Syncsort's data integration product, DMExpress™ v4.8, extracted, transformed, cleansed and loaded 5.4 TB of raw TPC-H data into the Vertica Analytic Database in 57minutes 21.51 seconds, using highly cost-efficient HP BladeSystem c7000 x86 servers running the RedHat Linux operating system.

Benchmark Details

The performance and scalability of DMExpress v4.8 and the prerelease version of Vertica v3.0 was tested using 16 two quad-core server blades and 16 storage blades in HP BladeSystem c-Class enclosures. The DBGEN tool from the TPC-H benchmark was used to generate the source data. DBGEN generates broadly representative business data that contains a variety of data types. A real-world business scenario was created by using multiple sources of data. The test was conducted using industry-standard architecture and system configurations.

The benchmark results were independently audited and verified by George Spofford of DSS Lab.