Find "Duplicate folders" with exact same file content and "Similar folders" with most (some %) of files being same

[avibathula]

Find "Duplicate folders" with exact same file content and "Similar folders" with most (some %) of files being same

[Krzysiu]

I like that, I had to recently make a Python script to do that. Alas, I hadn't idea how to implement "close, but not exact copies" hashing system.

[avibathula]

There are hashing techniques that can not only tell if two pieces of data are identical, but also provide a measure of how much they differ from eachother.

Example: SimHash (similarity hashing), MinHash, Jaccard similarity (mathematical measure used to quantify the similarity between two sets or lists of elements) etc.

[Krzysiu]

Yeah, I know, thanks, but my problem was implementing it for specifically for directories - I think I'd have to perpetual hash contents of both directories and then compare it somehow - keeping in mind there are elements that doesn't fit set.