farmadupe / vid_dup_finder Goto Github PK
View Code? Open in Web Editor NEWvid_dup_finder
License: Apache License 2.0
vid_dup_finder
License: Apache License 2.0
vid_dup_finder --files /home/rafal/Pictures --print-unique
error: Found argument '--print-unique' which wasn't expected, or isn't valid in this context
USAGE:
vid_dup_finder [OPTIONS] --files <Directories/files to search>...
For more information try --help
I am aware you mentioned that it does not work for videos under 30 seconds, but I wondered if there were any updates to this. Also, if there is anything I can help with, then just let me know
Hi,
Looks that your project allows to use duplicated videos, but currently I couldn't find any method how I could integrate it with my app Czkawka.
I suggest to move library to different workspaces and after that publish it in crates.io.
Currently also when I tried to compile app, I found that it require nightly Rust, which sadly prevents me from using it.
Can we have a way to change the 30 second limit? I have a bunch of videos with an identical intro sequence and I'd like to adjust the limit to 2 minutes or more. I understand that this increases the processing time, so keeping 30sec as default makes sense, but adding the ability to adjust this on a per-job basis would be very useful.
Exploring this tool further to identify video duplicates. It appears to perform significantly faster in comparison to videohash. However, I've noticed that the tool has a few issues:
A workaround is to use the "--exclude-exts" option to blacklist specific file types. But it would be more convenient to provide users with more flexibility in deciding the strategy. Here are some suggestions:
Of course, these last two options should be mutually exclusive.
So, i noticed some invalid "too short" messages. I have a directory with a lot of non-movie stuff.
Including source/compiled files of vid_dup_finder.
I did a scan a couple of times, inceasing the logfile number each time, like:
rm /home/test/.cache/vid_dup_finder/vid_dup_finder_cache.bin
./target/release/vid_dup_finder --files ~/TEMP/fingerprint/ 2>&1 |tee -a log5
Now we check the output messages (redacted the output. I used the same replacements for each file)
number=5; cat log${number} |grep short |sed 's|.*Too short : ||' |sort > log${number}_parsed.log
For example check "log5_compared_to_6_and_7.png".
In run 5 we got a "too short" message for "[rarbg]/.mp4". This did not happen in run 6.
I got a "inserting" in run 6 for this same file.
The same for "log8_compared_to_9_and_10.png"
"cache2/.mp4" failed in run 8. But was inserted in run "9".
As every run the order of the scanned files is different i think some variable is the loop. Or ffmpeg gets confused about all the non-movie files.
log5_parsed.log
log6_parsed.log
log7_parsed.log
log8_parsed.log
log9_parsed.log
log10_parsed.log
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.