Comments (2)
Particularly with Datasets, I definitely would prefer to just provide a single command/attribute to set the entire thing. I haven't thought through datatrees very carefully yet, but I think the same thing applies. My main goal of compression is to save space on my harddrive and having a single setting seems easier to me.
I also don't really understand why I would ever want to have different compression levels for individual DataArrays in a Dataset or datatree.
For context, I mostly save data as float32/64 and occasionally int64/32.
from datatree.
Or is recommended practice to update the compression info for each DataArray? (The second answer to the above link)
I'll just say that this is the approach I've been taking.
However, I do think there is some room for improvement to the current api. The challenge of course is that the per-variable or per-dataset encoding dictionary needs to map to tree structure. In practice these nested-dict data structures are unruly to work with and I've found myself finding plenty of functionality in the DataArray.encoding
approach.
@jwbrooks0 - I'm curious if you have thoughts on a possible api that meets your use case? Do you agree that a nested-dict of encoding parameters is less than ideal from an end-user perspective?
from datatree.
Related Issues (20)
- Tree linkage + dataset in one object nonideal for UI tree view HOT 6
- v0.0.14 not on pypi HOT 1
- setting node name breaks tree linkage HOT 7
- When creating a DataTree from a Dataset with path-like variable, subgroups are expected to be created HOT 8
- Actually you're right, I don't know if the docs currently mention anywhere that assigning to `.ds` is allowed!
- Typing: `DataTree[Unknown]`
- `drop_vars` issue? HOT 1
- Creating DataTree from DataArrays
- Opening a datatree from S3 bucket HOT 3
- Typing issue: Pylance complains with DataTree inequalities HOT 1
- open_datatree() keeps the hdf file open preventing writes HOT 2
- open_datatree() from zarr creates issues with `kwargs` HOT 4
- `open_datatree` performance HOT 2
- decision analysis in datatree? HOT 1
- Collapse by default the "Attributes" section in rich display HOT 1
- Add an `attrs` keyword argument to the constructor: `DataTree(attrs={})` HOT 1
- Describe a DataTree: adidng visualization and summarization capabilities HOT 1
- Rich display width is broken HOT 4
- Auto-plotting capabilities HOT 1
- Loosing attributes with .chunk and .pad
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datatree.