vyneer/tbf

finds VOD playlists on Twitch

tbf's Issues

[StreamsCharts] Get direct timestamp for vod

The current way to grab the VODs timestamp can now be found within the pages source code.
Example URL: https://streamscharts.com/channels/robcdee/streams/39638619239
HTML Snippet:

<div>
    <div class="-mt-2 overflow-x-hidden overflow-y-auto max-h-148" x-data="twitchClipsBlock()" x-init="getClips($dispatch)" data-requests="[{"broadcaster_id":"169185650","started_at":"2022-09-04T00:47:52+00:00","ended_at":"2022-09-04T04:47:52+00:00","first":50},{"broadcaster_id":"169185650","started_at":"2022-09-04T04:47:52+00:00","ended_at":"2022-09-04T08:47:52+00:00","first":50},{"broadcaster_id":"169185650","started_at":"2022-09-04T08:47:52+00:00","ended_at":"2022-09-04T11:50:00+00:00","first":50}]">
        ...
    </div>
</div>

Seems like a payload used for them to fetch all the clips. Only relevant one
Selector: div > div[data-requests]

The one concern I have is that they might change this in the future. Around two weeks ago you could still obtain the direct start timestamp, but you had to listen for network calls as they called Twitch's API for clips with the same payload. I noticed today when trying to add this improvement that they have changed it so the clip calls for a particular stream aren't made on the user's machine AFAIK but rather their backend? Instead, now the payload is within the HTML.

Output getting cut

As you can see from the image, stdout is getting cut after the first link it finds. I've noticed this happens a lot when there are multiple links found. The last link is the one that tends to get cut from my recollection.

[StreamsCharts] HTTP 403 errors getting VOD

Seems like lately TBF has been getting triggered by what I assume is Cloudflare? I keep getting the following error

[2022-09-04T21:45:08.673Z ERROR tbf] couldn't process the url: HTTP status client error (403 Forbidden) for url (https://streamscharts.com/channels/robcdee/streams/39638619239)

Though on the other hand, it usually works after 3-6 attempts

Nightly version via GitHub Actions

Is it possible for you to also add an action to build a nightly version of tbf with respect to the earliest commits? Would be nice in cases such as now where the version wasn't bumped but changes were made so the workflow never ran.