SQream Blue Sets New Performance Standards in Big Data Processing

SQream, a leading data acceleration platform, has announced the latest performance benchmarks for its cloud data solution, SQream Blue. The results set new industry standards in big data processing, data preparation, and ingestion, showcasing significant improvements in both speed and cost efficiency.

The nonprofit Transaction Processing Performance Council (TPC) developed TPCx-BB as a benchmark for objectively comparing Big Data Analytics System (BDAS) solutions. With its unique GPU parallelizing solution and patented technology, SQream Blue's recent performance demonstrates its ability to offer unparalleled ROI for SaaS big data projects at large-scale enterprises.

SQream Blue Outperforms Databricks in TPCx-BB Benchmark Analysis

During the comparison portion of the TPCx-BB analysis, SQream Blue shattered the existing performance benchmark, handling 30 TB of data three times faster and at ⅓ of the cost of Databricks' Spark-based Photon SQL engine.

This remarkable performance can be attributed to SQream Blue's ability to allocate available resources efficiently and its capacity to divide data processing between GPUs and CPUs, avoiding unnecessary overhead. This ensures unprecedentedly rapid results and optimal performance.

SQream Blue's Performance in Context

In its State of Big Data Analytics Report published in June of 2024, SQream found that 92% of companies surveyed are actively aiming to reduce cloud spend on analytics, 71% regularly experience 'bill shock', and 41% list high costs as the primary big data challenge. The performance of SQream Blue is equivalent to reading every cataloged book in the US Library of Congress in under an hour - and then buying them all for less than $25, highlighting how the solution can solve the cost-performance challenges associated with modern data analytics as a powerful addition to the tech stack.

Cost Performance: The Only Factor That Matters

Matan Libis, VP Product at SQream, emphasized the importance of cost performance in cloud analytics, stating, “In cloud analytics, cost performance is the only factor that matters. SQream Blue’s proprietary complex engineering algorithms offer unparalleled capabilities, making it the top choice for heavy workloads when analyzing structured data.”

SQream Blue's Performance in Real-World Scenarios

As part of the TPCx-BB assessment, SQream Blue tackled several data processing tasks typically encountered in real-world scenarios. Example queries included building a model to predict whether an online shopper would be interested in a given item category based on their online activities and demographic information.

How SQream Blue Achieved Its Impressive Results

SQream ran the benchmark on Amazon Web Services (AWS) with a scale factor of 30,000, which creates a dataset of around 30 TB, to test the relative capabilities of SQream at scale. All generated data was stored as Apache Parquet files on Amazon Simple Storage Service (Amazon  S3), and the queries were processed without pre-loading into a database.

SQream Blue vs. Databricks: A Detailed Breakdown

SQream Blue was tested against the data management solution Databricks and its most advanced query engine. During the comparison, SQream Blue's total runtime was 2462.6 seconds, with the total cost for processing the data end-to-end being $26.94. Databricks' total runtime was 8332.4 seconds, at a cost of $76.94, indicating a significant cost-performance advantage by SQream Blue for big data analysis. 

SQream Blue's Architecture: Streamlined Efficiency and Data Privacy

The solution's architecture contributes to its streamlined efficiency, as data does not need to be moved at any point during the preparation cycle. Rather, SQream Blue directly accesses data in open-standard formats at the customer's low-cost cloud storage to maintain privacy and ownership, preserving a single source and eliminating the need for data duplication.

SQream's Vision for the Future: Empowering Big Data Projects

With its groundbreaking capabilities and an increased demand for high-performance analytics solutions, SQream has positioned itself as a leader in the data processing industry. The company is currently realigning its organizational structure to better support its ambitious growth plans, with a particular focus on the US market. 

The Future of Big Data: Addressing Challenges and Expanding Opportunities

Big data projects with out-of-control costs or lengthy delays are a major headache for enterprise organizations. More widely if these common challenges are left unchecked could see big data projects move out of favor. 

SQream is responding to the widespread need for better data processing capabilities that complement other big data solutions in the enterprise tool kit. Available on AWS and Google Cloud marketplaces, SQream Blue is ready to bring these new service standards to big data projects worldwide.

Engineers, Analysts, and Journalists: Get a Live Demo of SQream Blue

Engineers, analysts, and journalists are invited to speak with SQream for an exclusive live-action demo of these results alongside a product manager.

For more information about SQream Blue and detailed results from the TPCx-BB benchmarks, visit: https://sqream.com/databricks-benchmarks

About SQream

SQream empowers companies to get value from their data that was unattainable before at an exceptional cost-performance. Our data processing and analytics acceleration platform utilizes a patented, GPU-based SQL engine that accelerates the querying of extremely large and complicated datasets. By leveraging SQream's advanced supercomputing capabilities for analytics and machine learning, enterprises can stay ahead of their competitors while reducing costs and improving productivity. To learn more, follow SQream on LinkedIn, Twitter, Facebook, or visit www.sqream.com.