Comments (5)
The answer at this point in time is no. The data partitioning (chunking) TimescaleDB uses is optimized for indexing the data so that queries, especially as they increase in complexity, are performant across larger volumes of data. With a columnar store you lose almost-all indexing (i.e., there is no B-tree support at all) so it doesn't make sense to combine the two models given our decisions. We've had some internal engineering discussions about some ideas for columnar storage, but it is not on any shorter-term roadmap.
from timescaledb.
Also - If you feel comfortable sharing the general structure of the data you are storing (and the relevant queries), we can also take a closer look / make suggestions on how we'd recommend to best store that data in Timescale.
from timescaledb.
I recognize that columnar storage is poor for certain workloads and better for others. My main issue is the cost of table scans when a given column-narrow ad-hoc query cannot be resolved by an index.
I suspect the biggest win for my sort of queries would be if could apply parallel disk read + filtering (in this case for 1 server with a 10-way disk array and may cores). This would be, without the hardware, similar to what Netezza does, i.e. parallel reads with filtration based on what part of a query can be run on a chunk of data, on each tightly coupled cpu <-> disk.
At the moment, short of creating numerous indices across many rows, some queries will involve a linear table scan. Linear scan can work reasonably well with parallelism.
from timescaledb.
Hi @tr8dr, sorry for the delay in responding.
One of the lesser-advertised features in our recent 0.1.0 release is the ability to associate multiple Postgres tablespaces with a single hypertable, so that this single "table" can reside across multiple disks, and chunks belonging to this hypertable can be then queried in parallel.
Better documentation is forthcoming for the new attach_tablespace()
API command, but if you are interested in the details:
from timescaledb.
@tr8dr I'm going to close out this issue unless there's anything else?
from timescaledb.
Related Issues (20)
- [Bug]: pg_upgrade cannot upgrade 2.12.2-pg13 to 2.14.2-pg15 HOT 4
- [Bug]: max_tuples_decompressed_per_dml_transaction is not working as expected HOT 5
- [Bug]: Add_dimension errors that only integer, timestamp and date data fields are supported, but smallint is also working HOT 4
- [Bug]: FATAL: extension "timescaledb" must be preloaded HOT 4
- [Bug]: Segfault when `ts_insert_blocker` function is called HOT 2
- [Bug]: Upgrade Version From 2.10.1 To 2.14.2 Failing With Error Constraint Foreign Key on bgw_job_stat tables HOT 4
- [Feature]: RLS for hypertables with compression
- [Bug]: Dependency tracking of hierarchical caggs HOT 5
- [Bug]: Upgrade Version From 2.10.1 To 2.14.2 Failing With loader version out-of-date HOT 5
- [Feature]: caggs on top of tables with RLS enabled
- [Feature]: Force refresh continious aggregate
- [Bug]: create_hypertable(..., migrate_data=>true) doesn't create a valid partition index
- [Bug] Unneeded sorting of compressed chunk table with aggregation
- [Bug]: Decompression doesn't handle visibility properly
- [Bug]: Compression doesn't handle visibility correctly
- [Bug]: time_bucket_gapfill with named timezone gives incorrect result HOT 9
- [Bug]: Running concurrent tests on a TimescaleDB instance HOT 5
- [Bug]: Compression leads to corrupt table HOT 4
- [Bug]: Before Update trigger on hypertable make updates fail HOT 4
- [Bug]: Slow query when trying to retrieve tuples used in chunk segmentation HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from timescaledb.