Plan a transition of unixfs to go-ipld-prime

[ipfs]

Plan a transition of unixfs to go-ipld-prime

[welcome]

Thank you for submitting your first issue to this repository! A maintainer will be here shortly to triage and review.
In the meantime, please double-check that you have provided all the necessary information to make this process easy! Any information that can help save additional round trips is useful! We currently aim to give initial feedback within two business days. If this does not happen, feel free to leave a comment.
Please keep an eye on how this issue will be labeled, as labels give an overview of priorities, assignments and additional actions requested by the maintainers:

• "Priority" labels will show how urgent this is for the team.
• "Status" labels will show if this is ready to be worked on, blocked, or in progress.
• "Need" labels will indicate if additional input or analysis is required.

Finally, remember to use https://discuss.ipfs.io if you just need general support.

[Stebalien]

should FSNode continue to use the protobuf-generated struct implementation, or should we generate an equivalent ipld-prime node representation of that data?

I'd actually rather write custom code. We need to guarantee a somewhat funky encoding order anyways.

enumerate the interfaces (e.g. a quick glance shows public methods like NewShard make use of a dag service) that would ideally transition from reliance on ipld-format/go-merkeldag to prime equivalents (maybe you haves started this, @gammazero ?)

We'll likely have to throw away almost all of the current interfaces.

[willscott]

We'll likely have to throw away almost all of the current interfaces.

I guess the main question is what things do we care about stability on / are problematic to break / should continue to be supported. If we have the top level CLI functionality remain the same are we okay? Would you suggest making a separate implementation for the CLI to use and have a way for consumers to use this implementation with the go-ipld-legacy shim until they're ready to transition?

[Stebalien]

The top-level CLI should continue to work. In terms of this library, I'd actually just crate a new one (maybe go-ipfs-fs?) and merge in everything you need (likely pieces of go-ipfs-chunkers, go-unixfs, go-ipfs-files, and go-merkledag).

If we want to stick with a single repo, also feel free to go with a v2.

[gammazero]

@willscott I have stayed away from making changes to unixfs so far, but need to so was hoping to know what we want to do with unixfs very soon.

[willscott]

Things building on UnixFS we're aware of:

• CLI & Core API
• MFS
• Gateway

[Jorropo]

This repository is no longer maintained and has been copied over to Boxo. In an effort to avoid noise and crippling in the Boxo repo from the weight of issues of the past, we are closing most issues and PRs in this repo. Please feel free to open a new issue in Boxo (and reference this issue) if resolving this issue is still critical for unblocking or improving your usecase.

You can learn more in the FAQs for the Boxo repo copying/consolidation effort.

---

IMO redundent after ipfs/boxo#224 ping me if you want to reopen and move this anyway.