[Question] How are videos uploaded during a channel playlist download handled?

[yt-dlp]

[Question] How are videos uploaded during a channel playlist download handled?

[pukkandan]

it's possible a video that belongs in a playlist could get missed during a long first run and then inadvertently added to the archive.log during the second, channel based job

Yes. Here's a trick to handle this:

(My example code is for windows, but you can easily adapt it for unix)

:start
set has_new_dl=0
youtube-dl URL --download-archive archivefile --exec "set has_new_dl=1 && echo.Downloaded: {}"`
if ["%has_new_dl%"]==["1"] goto start

This will loop until youtube-dl runs once without downloading anything

[pukkandan]

Another trick would be to use youtube-dl URL --get-id --download-archive archivefile to check if there are any un-downloaded videos. But this will return any deleted/blocked videos as well

[undaunt]

Thanks, let me work on this today before I close things out but super helpful!

[undaunt]

Check out my main file https://github.com/undaunt/youtube-metadata-parse/blob/master/bin/yt-dlc-execute.sh

[pukkandan]

I see you are using a file rather than a variable, but that's fine.

Have you tried running it though? I suspect it wont work. Since the exec command has no {}, youtube-dl tries to add one at the end. So the command is treated as --exec "touch $MEDIADIR/youtube/new.downloads {}". This is done so that something like --exec post.sh will get the filename as the argument.

You should probably use {} > $MEDIADIR/youtube/new.downloads instead of touch

Edit: Upon testing, it seems touch takes multiple files as args. It is touching both new.downloads as well as the downloaded file. So it will work, no problem

[undaunt]

I had issues setting the variable between the various bash shells. Touching a file and then checking for its existence cleared that up.

Thanks for testing, I just woke up and was going to re-test to confirm.