tawawhite/tensorbase

TensorBase is a new big data warehousing with modern efforts.

What is TensorBase

TensorBase is a new big data warehousing with modern efforts.

TensorBase is building on top of Rust, Apache Arrow and Arrow DataFusion.

TensorBase hopes to change the status quo of bigdata system as follows:

• low efficiency (in the name of 'scalable')
• hard to use (for end users) and understand (for developers)
• not evolving with modern infrastructures (OS, hardware, engineering...)

Features

• Out-of-the-box to play ( get started just now )
• Lighting fast architectural performance in Rust ( real-world benchmarks )
• Modern redesigned columnar storage
• Top performance network transport server
• ClickHouse compatible syntax
• Green installation with DBA-Free ops
• Reliability and high availability (WIP)
• Cluster (WIP)
• Cloud-Native Adaptation (WIP)
• Arrow dataLake (...)

Architecture (in 10,000 meters altitude)

Quick Start

• Get Started for Users

• Get Started for Developers

Benchmarks

TensorBase is lighting fast. TensorBase has shown better performance than that of ClickHouse in simple aggregation query on 1.47-billion rows NYC Taxi Dataset.

TensorBase has enabled full workflow for TPC-H benchmarks from data ingestion to query.

More detail about all benchmarks seen in benchmarks.

Roadmap

• Base Space Station

Community Newsletters

• This Week in TensorBase

Working Groups

Working Group - Engineering

This is a wg for engineering related topics, like codes or features.

Working Group - Database

This is a higher kind wg for database related topics, like ideas from papers.

Join these working groups on the Discussions or on Discord server.

Communications

• Discussions

• Discord server

• Slack Channel

Wechat group or other more are on community

Contributing

Read the Contributing.

Note: Recently, we enforce code style via cargo fmt.

Documents (WIP)

More documents will be prepared soon.

Read the Documents.

License

TensorBase is distributed under the terms of the Apache License (Version 2.0), which is a commercial-friendly open source license.

It is greatly appreciated that,

• you could give this project a star, if you think these got from TensorBase are helpful.
• you could indicate yourself in Who is Using TensorBase, if you are using TensorBase in any project, product or service.
• you could contribute your changes back to TensorBase, if you want your changes could be helpful for more people.

Your encouragements and helps can make more people realize the value of the project, and motivate the developers and contributors of TensorBase to move forward.

See LICENSE for details.