Comments (6)
Status update:
- bioformats2raw is moving towards 0.3.0. There will already be some breaking layout changes.
- zarr-python has the FSStore fixe merged to the mainline. The 2.7.0 release will contain it.
- The jzarr work will be taken over by @SabineEmbacher but is moving forward.
With all of this in mind, I'd propose that we go ahead and bump to OME-Zarr version to 0.2.0 stating in the spec that nested storage is a MUST. A client can then detect whether the fileset is 0.1.0 or 0.2.0 from the metadata and make a choice as to the chunk index separator.
cc: @manzt (since I've failed to engage on the JS front)
from ngff.
Here's what I've been working on:
- n5 supports nested (of course) but zarr+s3 is missing: saalfeldlab/n5-zarr#5
- jzarr doesn't support nested: bcdev/jzarr#17
- NestedDirectoryStore supports zarr+nesting but not s3. The newer FSStore which does support s3 had a bug in the nesting: zarr-developers/zarr-python#699
Conversations starting https://gitter.im/zarr-developers/community?at=601d471fc83ec358be27944f and during the 2021-02-10 community call suggest that even before the V3 spec (which defaults to nested storage) it might be possible for us to transition to using it more heavily with the V2 spec. A requirement would be a heuristic or metadata entry to determine if chunks are nested or flat. zarr-python is waiting on a PR from me.
from ngff.
Feels like most implementations have now implemented this new strategy. Likely a solid next step would be to add v0.1 and v0.2 implementations to https://github.com/ome/ome_zarr_test_suite
from ngff.
This issue has been mentioned on Image.sc Forum. There might be relevant details there:
https://forum.image.sc/t/next-call-on-next-gen-bioimaging-data-tools-feb-23/48386/9
from ngff.
see: zarr-developers/zarr-python#715
from ngff.
This issue has been mentioned on Image.sc Forum. There might be relevant details there:
https://forum.image.sc/t/open-an-image-from-omero-in-imagej-js/47747/17
from ngff.
Related Issues (20)
- website: document hosting a community call
- website: roadmap/status page HOT 1
- Adopt Zarr v3 HOT 8
- Clarification of whether top-level fields in spec are optional or required
- Link to the JSON schemas from the spec HOT 2
- Change `version` field(s) from SHOULD to MUST HOT 1
- Optional sub-group(s) in multiscale image HOT 1
- Document image.sc @ngff group and/or alternative mailing list
- relax omero metadata HOT 2
- Add rtd metadata to enable doc contributions HOT 1
- Clarify dimension order in the specs HOT 2
- total coordinates HOT 14
- How to make multiscale image parsing more deterministic HOT 6
- Simplifying multiscale coordinateTransformations HOT 1
- units for data HOT 2
- should `multiscales` be a collection? HOT 3
- Single-scale images HOT 2
- clearly defined anatomical orientation HOT 28
- extra fields in metadata
- Author, license, project description, and other free text metadata HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ngff.