Chunker: Not storing/preserving system metadata other than ModTime

[eharris]

Chunker: Not storing/preserving system metadata other than ModTime

[ncw]

Hmm, yes, the fact that chunker is advertising metadata support is an oversight I think.

Chunker would have to store the metadata somewhere, either as metadata on an object or in the metadata file (if one is configured).

The question is which object should chunker be storing the metadata on - all of them?

[eharris]

I wasn't sure if the capabilities shown by features was meant to indicate that it would actually store the metadata, or just that it is supposed to pass it along to the final remote. That's why I used the local fs as the underlying remote, because I know that local supports the metadata even when many cloud remotes don't. It wasn't clear either way.

At the very least, chunker should "pass along" the metadata, which is why I created this ticket as a bug. But yes, I think that (since chunker already has a simple and expandable method to store additional metadata which is being used for hashes) if chunker doesn't automatically store the additional metadata, that capability should be able to be easily added, perhaps with an additional option.

[ncw]

I wasn't sure if the capabilities shown by features was meant to indicate that it would actually store the metadata, or just that it is supposed to pass it along to the final remote.

For a wrapping backend like chunker, it is supposed to pass the metadata along to the underlying backend. This doesn't appear to be working though.

That's why I used the local fs as the underlying remote, because I know that local supports the metadata even when many cloud remotes don't. It wasn't clear either way.

At the very least, chunker should "pass along" the metadata

It should either pass it along or not advertise the metadata Feature, yes.

which is why I created this ticket as a bug. But yes, I think that (since chunker already has a simple and expandable method to store additional metadata which is being used for hashes) if chunker doesn't automatically store the additional metadata, that capability should be able to be easily added, perhaps with an additional option.

That would be a good addition.