ipfs-shipyard / dagger Goto Github PK
View Code? Open in Web Editor NEW๐ก๏ธ - an elegant slicer for a more civilized age
License: Other
๐ก๏ธ - an elegant slicer for a more civilized age
License: Other
Aside from the extensive help menu already available, the repo needs a relatively large writeup explaining motivation / scoping / present state-of-the-art / likely exploration directions.
This is a blocker for public release, especially given the perceived simplicity of the problem domain.
The current repo was deliberately left "unstructured"
After the rewrite of the STDIN ingestion mechanism, a bug in the core interface of the "chunker chain" got exposed. The manifestation is a 1-in-20 mismatch in expected CIDs of the test data.
The usual tools ( go -race
etc ) and even print-debugging are not available, as ( what I think is ) the race condition is so tight that any slowdown introduced by debugging tools causes the bug to no longer manifest itself ๐คฆ
This is the only current "known unknown".
A proof of concept for this functionality was demoed in February, but subsequently was removed as it was very tightly coupled with the ( solely available at the time ) fixedsize chunker.
Now that the chunking interface is stabilized ( pending final bugs ) the sparse chunker can be easily reimplemented in terms of that interface.
This is a blocker for public release, being a cheap way to demonstrate the outsize effect of generic-structure-aware chunking.
My version of go
(go1.14.5 darwin/amd64) is unhappy with a pathname with nul
in it:
package github.com/ipfs-shipyard/DAGger/internal/dagger/collector/nul: github.com/ipfs-shipyard/DAGger/internal/dagger/collector/nul: invalid import path: malformed import path "github.com/ipfs-shipyard/DAGger/internal/dagger/collector/nul": disallowed path element "nul"
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.