wuchunfu/sql-ds-cache

Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.

* LEGAL NOTICE: Your use of this software and any required dependent software (the "Software Package") is subject to the terms and conditions of the software license agreements for the Software Package, which may also include notices, disclaimers, or license terms for third party or open source software included in or with the Software Package, and your use indicates your acceptance of all such terms. Please refer to the "TPP.txt" or other similarly-named text file included with the Software Package for additional details.

* Optimized Analytics Package for Spark* Platform is under Apache 2.0 (https://www.apache.org/licenses/LICENSE-2.0).

SQL Index and Data Source Cache

SQL Index and Data Source Cache is an optimized plug-in package designed to accelerate Spark SQL* performance by using index and cache technology at the Spark* SQL data source layer. Indexing can improve Spark interactive query performance by as much as an order of magnitude, and caching delivers additional Spark* SQL query performance benefits. We support both DRAM and Intel® Optane™ Persistent Memory as cache media.

Please refer to these documents for more information:

• Architecture Overview
• User Guide
• Developer Guide

Online Documentation

You can find the all the SQL DS Cache documents on the project web page.

*Other names and brands may be claimed as the property of others.