Vod2Pod-RSS converts a YouTube or Twitch channel into a podcast with ease. It creates a podcast RSS that can be listened to directly inside any podcast client. VODs are transcoded to MP3 on the fly and no server storage is needed!
License: MIT License
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
app version: 1.1.0
issue description:
I want to set up vod2pod on my raspberry pi 1b. It is running raspbian on a 32bit architecture. When I try to run vod2pod via docker I get the following:
> sudo docker compose up -d
[+] Running 0/3
⠴ redis Pulling 7.5s
⠴ api_keys Pulling 7.5s
⠼ vod2pod Pulling 7.5s
no matching manifest for linux/arm/v6 in the manifest list entries
app version: v1.1.1
I would be great to add an option to filter videos by duration. For example, some channels that I follow don't have playlist and if I add the channel URL to vod2pod I get a lot of shorts videos
app version: 1.1.0
issue description: I am using audibookshelf to automate downloading of the audios from the link and it is banning the recursion (I am sure that is the right term) of the host back to the internal local IP when I am about to download the podcast from the supplied link (using the nginx and duckdns), so can we have a host in the docker-compose.yml?, A similar app that I am using podsync has a host in the config file, I will like to switch to vod2pod because it does not download the podcast into my PC, thank you.
Add support for selfhosted server - Peertube and other independent servers, plz.
app version: X.X.X
issue description:
in docker-compose.yml
- YT_API_KEY=AIzaSyDDzD9kXXXXXXX
is this right？
The current system is vulnerable to a blind SSRF attack
Based on the limited demo logs there are multiple instances of people giving a raw video url instead of a playlist or channel url, which of course gives a generic url unsupported error
issue description:
I submit a Youtube url at https://y2pod.com, it responses 409 error and no messages.
app version: 1.1.0
issue description:
Logs do not seem informative. All of the podcasts are visible in iTunes, but the feeds are empty. When I select "Refresh Podcast" in the iTunes menu for each feed, nothing changes on the UI, but I get logs like this:
vod2pod-rss-vod2pod-1 | 2024-01-26T16:36:45.738Z DEBUG [vod2pod_rss::provider] using TwitchProvider
vod2pod-rss-vod2pod-1 | 2024-01-26T16:36:45.741Z INFO [vod2pod_rss::server] serving cached rss feed for https://www.twitch.tv/thejrm_
vod2pod-rss-vod2pod-1 | 2024-01-26T16:37:31.593Z DEBUG [vod2pod_rss::provider] using TwitchProvider
vod2pod-rss-vod2pod-1 | 2024-01-26T16:37:31.595Z INFO [vod2pod_rss::server] serving cached rss feed for https://www.twitch.tv/ev3ntic
Usually those are livestreams
app version: X.X.X
issue description:
due to youtube atom feed limitation no more that 15 videos can be fetched, this is not a big problem for channels since it uses a FIFO logic so new videos have precedence, but for playlist new videos are usually put in last so is pretty limiting.
To fix this it will be needed add an optional api key for youtube that when present will set the url to fetch the rss from to an internal service that will handle the new RSS creation. this new service will be added to the docker compose.
Some research is needed to check if such service already exists, also to anyone who wants to contribute feel free to make such service and shout it out here
app version: 1.0.0
issue description: When i either download through browser, through podcast addict or if I copy/paste ffmpeg command and run it locally, the download speed is ~35KB/s. My internet speed is 1000/500 (Mbit/s).
Is there a configuration I'm missing?
Thanks for really useful product!
2023-05-12T04:52:36.239Z INFO [app] app version 1.0.0
2023-05-12T04:52:36.274Z INFO [app] starting server at http://0.0.0.0:8080
2023-05-12T04:52:36.274Z INFO [actix_server::builder] starting 4 workers
2023-05-12T04:52:36.274Z INFO [actix_server::server] Actix runtime found; starting in Actix runtime
2023-05-12T04:52:43.117Z INFO [app] processing transcode at 192k for https://www.youtube.com/watch?v=BMr7Bz8eGus
2023-05-12T04:52:43.117Z INFO [vod2pod_rss::transcoder] detected youtube url, need to find the stream url if not in cache
2023-05-12T04:52:46.076Z INFO [vod2pod_rss::transcoder] generated ffmpeg command:
ffmpeg -ss 0 -i https://rr4---sn-8p2oxu-15bs.googlevideo.com/videoplayback/... -acodec libmp3lame -ab 192k -f mp3 -bufsize 5760 -maxrate 5760k -timeout 300 -hide_banner -loglevel error pipe:stdout
2023-05-12T04:52:46.080Z INFO [vod2pod_rss::transcoder] streaming to client
app version: v1.0.2
issue description:
Can you please update yt-dlp to the latest stable?
Running yt-dlp --version in the vod2pod container shows it's using version 2023.03.04. I've started getting download errors with this version:
ERROR [vod2pod_rss::transcoder] https://rr2---sn-nx57ynss.googlevideo.com/videoplayback?............: Server returned 403 Forbidden (access denied)
Running this in the vod2pod container resolves the issue for me: yt-dlp --update-to 2023.07.06
Thanks
app version: 1.2.1
issue description:
Initial setup looks like its trying to use a built in redis instance but I get this error:
Error interacting with Redis (redis is required): NOAUTH: Authentication required.
I run a dedicated redis instance for other containers, I tried using REDIS_ADDRESS/REDIS_PORT to point to my container (even though it says not to in the docs...) but it did not fix that error. My redis instance does have a password so I tried adding REDIS_PASSWORD var and also disabling password auth and no luck.
Hi,
Thanks for your work on this cool project!
On Reddit you asked for an issue to be created as a reminder to add additional codecs besides MP3.
So this is just a friendly reminder - MP3 is working great.
A good choice would be the fully open source Opus codec.
It’s way more efficient than mp3 and has rather good support across all platforms. It’s also very low impact on resources both in encoding and decoding.
Another good open source codec to consider would be OGG Vorbis.
But as you said on Reddit - the defacto standard in podcasting is still MP3. So I’d add these as optional choices for the tinkerers and keep MP3 as the default setting.
Thanks.
app version: 1.1.0
Environment:
Docker / Linux
vod2pod 1.1.0
when playing the new feed on a client like an RSS reader or Google Podcast for the first time, server will not respond.
This log will show up on the server when the client clicks play:
2023-11-23T21:32:57.800Z INFO [vod2pod_rss::server] processing transcode at 320k for https://www.youtube.com/watch?v=fvJaGKNGKN4
4 minutes later (depending on the length of the video), this log showed up indicating the stream was ready:
2023-11-23T21:37:19.812Z INFO [vod2pod_rss::transcoder] generated ffmpeg command:
And this problem did not exist a couple of months ago.
another minor issue is, the environment variable for setting the bitrate seems not working. In the readme.md, the name of that environment variable is "BITRATE", however, in the docker-compose.yaml, is "MP3_BITRATE".
No matter which is the right one, the server will transcode to 320k regardless.
2023-11-23T21:32:50.618Z INFO [app] app version 1.1.0
2023-11-23T21:32:50.619Z INFO [app] listening on http://0.0.0.0:8080
2023-11-23T21:32:50.619Z INFO [actix_server::builder] starting 12 workers
2023-11-23T21:32:50.619Z INFO [actix_server::server] Actix runtime found; starting in Actix runtime
2023-11-23T21:32:57.800Z INFO [vod2pod_rss::server] processing transcode at 320k for https://www.youtube.com/watch?v=fvJaGKNGKN4
2023-11-23T21:37:19.812Z INFO [vod2pod_rss::transcoder] generated ffmpeg command: < MORE THAN 4 MINUTES LATER
ffmpeg -ss 0 -i https://rr1---sn-a5meknsy.googlevideo.com/videoplayback?expire=1700797033&ei=CcZfZYTXMf67sfIP7emBQA&ip=99.113.211.182&id=o-AMcrWha1mF-lrej7F4OLKU2zPMGUB59KYwLjb_3-URTd&itag=251&source=youtube&requiressl=yes&mh=CL&mm=31%2C26&mn=sn-a5meknsy%2Csn-o097znsl&ms=au%2Conr&mv=m&mvi=1&pl=18&initcwndbps=842500&spc=UWF9f62sKa6lv09a_XZYMUJTIsjdn8c&vprv=1&svpuc=1&mime=audio%2Fwebm&gir=yes&clen=2837460&dur=162.561&lmt=1700622448980383&mt=1700774929&fvip=5&keepalive=yes&fexp=24007246&c=ANDROID&txp=5532434&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cspc%2Cvprv%2Csvpuc%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=ANLwegAwRgIhANLzrq73JU8mvWSt0qzozYywEYz1ES7pQACQDqI9itvpAiEApKK_GZdcZlruUKmD55st9dsNZ2wyRAOd3OqkUCRilZg%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AM8Gb2swRgIhANnfrTFQXL5U6iiUSCVGpouOk85q9SNDLjIl8WSC68iLAiEA4fIuhaK5kfNJYslW3V4QXfF2oOC-KDo6PPSuI39UhHE%3D -acodec libmp3lame -ab 320k -f mp3 -bufsize 9600 -maxrate 9600k -timeout 300 -hide_banner -loglevel error pipe:stdout
2023-11-23T21:37:19.812Z INFO [vod2pod_rss::transcoder] streaming to client
2023-11-23T21:37:20.316Z INFO [vod2pod_rss::transcoder] connection to client dropped, stopping transcode
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
HOSTNAME=vod2pod-6f67f6b946-dsrlv
REDIS_ADDRESS=redis.core.svc.cluster.local
REDIS_PORT=6379
YT_API_KEY=**************************
TZ=America/Los_Angeles
BITRATE=192
MP3_BITRATE=192
TRANSCODE=true
SUBFOLDER=/
RUST_LOG=INFO
HOME=/root
currently the front end is missing a favicon.
I suck at desinging icons, so if anyone wants to make one feel free to open a PR and add a folder called static in the root of the repo and your favicon.ico file there.
I will assign this issue to myself if I decide to start working on it.
I'm not satisfied by my first attempt at it, I tested it's power by implementing one new provider and found it pretty leaky of it's internals.
With this I would like to open the path to redesign the flow, so that changes to apis or other provider specific weirdness could be handled.
The requirements for a provider are this
The documentation will also ask to cache the data with redis when possible
This will mean provider will have some duplicated code in them, that is fine it will allow for better flexibility, it will also still use other services to get the actual rss but the next steps will be to kill this dependencies and do all the parsing in rust to improve performance and easier updates in case API invetably change
youtube does not put the channel avatar in the feed
there are 2 main way to add it that I foud
app version: v1.1.1
I have added a youtube playlist with more than 300 videos and the newest ones are not shown, but the oldest ones. Can you modify it to get more than 300 videos or to get the videos from the newest ones?
In case you want to try, this is the playlist I had problems with.
https://www.youtube.com/playlist?list=PL-5YtFfXdaFS5DjNzFmwwcF3ab2keYyd3
Brilliant work, this! Was really looking for a solution like this!
I just started the service on a Raspberry Pi, but I can't get it to work. Every time I submit a YouTube account or playlist I get this error message:
2023-05-07T18:19:01.758Z ERROR [app] could not translate rss
2023-05-07T18:19:01.759Z ERROR [app] could not parse rss, reason: unable to parse feed: no root element
I'm not sure where to look to solve this issue, do you have an idea where I could start?
I am try to run your Docker image via Portainer and get this error.
I am try several time, change network setting and other and try to search in Google same problem but not found resolve.
Host system in my NAS x86 platform. linux x86_64 QTS 5.2.0 (20240417)
Error message
2024-05-12T07:23:46.449Z INFO [app] app version 1.2.1
thread 'main' panicked at src/main.rs:22:9:
Error interacting with Redis (redis is required): Connection refused (os error 111)
:
/tmp/vod2pod/src/lib.rs:13:15
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
2024-05-12T07:23:51.338Z INFO [app] app version 1.2.1
thread 'main' panicked at src/main.rs:22:9:
Error interacting with Redis (redis is required): Connection refused (os error 111)
:
/tmp/vod2pod/src/lib.rs:13:15
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
app version: latest
issue description:
Hello :)
From Portainer, I can not start the docker, getting this logs :
2023-08-26T19:55:57.145Z INFO [app] app version 1.0.2
thread 'main' panicked at 'Error interacting with Redis (redis is required): Connection refused (os error 111)
�
:
src/main.rs:46:19', src/main.rs:18:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2023-08-26T20:00:49.867Z INFO [app] app version 1.0.2
thread 'main' panicked at 'Error interacting with Redis (redis is required): Connection refused (os error 111)
�
:
src/main.rs:46:19', src/main.rs:18:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2023-08-26T20:08:36.862Z INFO [app] app version 1.0.2
thread 'main' panicked at 'Error interacting with Redis (redis is required): Connection refused (os error 111)
�
:
src/main.rs:46:19', src/main.rs:18:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Thanks !
Only happens on v1.1 beta
Since podcast clients tend to cache duration this blocks release 1.1
The filter was there in my other project TwitchToPodcastRSS, I just forgot to port it.
If anyone wants to tackle this write a comment asking to get assigned otherwise I'll do it first chance I get.
The fix should be easy and only confined inside twitch.rs
from a comment on reddit it seems apple podcast has some incompatibility issues
2023-05-07T07:31:12.144Z INFO [vod2pod_rss::transcoder] detected youtube url, need to find the stream url if not in cache
2023-05-07T07:31:12.146Z DEBUG [vod2pod_rss::transcoder] getting stream_url for yt video: https://www.youtube.com/watch?v=...
2023-05-07T07:31:14.157Z DEBUG [vod2pod_rss::transcoder] generating ffmpeg command
2023-05-07T07:31:14.157Z INFO [vod2pod_rss::transcoder] generated ffmpeg command:
ffmpeg -ss 0 -i https://mk7—sour.googlevideo.com/videoplay…. -acodec libmp3lame -ab 192k -f mp3 -bufsize 5760 -maxrate 5760k -timeout 300 -hide_banner -loglevel error pipe:stdout
2023-05-07T07:31:14.158Z INFO [vod2pod_rss::transcoder] streaming to client
2023-05-07T07:31:14.443Z DEBUG [vod2pod_rss::transcoder] channel closed
2023-05-07T07:31:14.443Z INFO [vod2pod_rss::transcoder] connection to client dropped, stopping transcode
2023-05-07T07:31:14.448Z DEBUG [vod2pod_rss::transcoder] ffmpeg stderr closed
seems like it is not liking what is receiving and killing the connection right away, unfortunately I don't have an apple device to replicate the issue, while I wait for the occasion if anyone finds more info please share it here, pull request with a fix are also welcome if there is a bug
Instead of padding with 0 bytes when using mp3 codec it should return a proper repeated empty mp3 frame: header+body
app version: 1.0.1
would be nice to have
app version: X.X.X
issue description:
With 1.0.4 Only one video will be obtained from the YouTube link, and it is not playable.
Downgrading to 1.0.2 fixed the problem.
kubectl logs vod2pod-64f65b5b9b-tphnw -f
Defaulted container "vod2pod" out of: vod2pod, podtube
2023-10-19T00:00:48.813Z INFO [app] app version 1.0.4
2023-10-19T00:00:48.814Z DEBUG [app] cached app version Some("1.0.4")
2023-10-19T00:00:48.814Z DEBUG [app] set cached app version to 1.0.4
2023-10-19T00:00:48.814Z INFO [app] starting server at http://0.0.0.0:8080
2023-10-19T00:00:48.814Z INFO [actix_server::builder] starting 12 workers
2023-10-19T00:00:48.814Z INFO [actix_server::server] Actix runtime found; starting in Actix runtime
2023-10-19T00:01:12.379Z INFO [app] processing transcode at 320k for https://www.youtube.com/watch?v=-uHjDNm3sgM
2023-10-19T00:01:12.380Z DEBUG [vod2pod_rss::provider] using YoutubeProvider
2023-10-19T00:01:12.380Z DEBUG [app] received content range 0-
2023-10-19T00:01:12.380Z DEBUG [app] requested content-range: bytes 0-11359999/11360000
2023-10-19T00:01:12.380Z DEBUG [app] choosen seek_time: 0
2023-10-19T00:01:12.380Z DEBUG [app] seconds: 284, bitrate: 320
2023-10-19T00:01:12.380Z DEBUG [vod2pod_rss::provider] using YoutubeProvider
2023-10-19T00:01:12.381Z DEBUG [vod2pod_rss::provider::youtube] getting stream_url for yt video: https://www.youtube.com/watch?v=-uHjDNm3sgM
2023-10-19T00:01:13.682Z WARN [vod2pod_rss::provider::youtube] error while parsing stream url:
input:
error: relative URL without a base
2023-10-19T00:01:34.113Z DEBUG [vod2pod_rss::provider] using YoutubeProvider
2023-10-19T00:01:34.114Z INFO [vod2pod_rss::provider::youtube] trying to convert youtube channel url https://www.youtube.com/@dacongmovie
2023-10-19T00:01:34.119Z DEBUG [reqwest::connect] starting new connection: http://127.0.0.1:15000/
2023-10-19T00:01:34.119Z DEBUG [hyper::client::connect::http] connecting to 127.0.0.1:15000
2023-10-19T00:01:34.119Z DEBUG [hyper::client::connect::http] connected to 127.0.0.1:15000
2023-10-19T00:01:34.119Z DEBUG [hyper::proto::h1::io] flushed 94 bytes
2023-10-19T00:01:37.446Z DEBUG [hyper::proto::h1::io] parsed 6 headers
2023-10-19T00:01:37.446Z DEBUG [hyper::proto::h1::conn] incoming body is content-length (61593 bytes)
2023-10-19T00:01:37.447Z DEBUG [hyper::proto::h1::conn] incoming body completed
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::rss_transcodizer] parsed feed
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::rss_transcodizer] Title found: 大聪看电影
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::rss_transcodizer] Description found: 过度解读&脑洞解析
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::rss_transcodizer] image found, logo branch: x=Image { uri: "https://yt3.ggpht.com/Q9YQlHCRE8GV6_fhKSH0uQXqi1Sylqwmio_bTRX5jWNyFj1fKHGmG2TSDnYVvuJP8JjuMT6M8Q=s800-c-k-c0x00ffffff-no-rj", title: Some("大聪看电影"), link: Some(Link { href: "https://www.youtube.com/channel/UCkM0vZ9Q2ZxxRPORzTDI7eg", rel: None, media_type: None, href_lang: None, title: None, length: None }), width: None, height: None, description: None }
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::provider] using GenericProvider as provider
2023-10-19T00:01:37.449Z DEBUG [vod2pod_rss::rss_transcodizer] item title: 《阿凡達2》最終版預告解析！老二社死名場面！更多畫面細節曝光！#阿 凡達2 #阿凡达2
2023-10-19T00:01:37.450Z WARN [vod2pod_rss::rss_transcodizer] no media_url found out of:
""
2023-10-19T00:01:37.450Z WARN [vod2pod_rss::rss_transcodizer] links analyzed:
""
2023-10-19T00:01:37.450Z WARN [vod2pod_rss::rss_transcodizer] regex used:
"^(https?://)?.+\\.(mp3|mp4|wav|avi|mov|flv|wmv|mkv|aac|ogg|webm|3gp|3g2|asf|m4a|mpg|mpeg|ts|m3u|m3u8|pls)$"
2023-10-19T00:01:37.450Z DEBUG [vod2pod_rss::provider] using GenericProvider as provider
2023-10-19T00:01:37.450Z DEBUG [vod2pod_rss::rss_transcodizer] item title: 🜃1899🜃你看懂了嗎！深度解析這一切到底發生了什麼！#1899 #暗黑
2023-10-19T00:01:37.451Z WARN [vod2pod_rss::rss_transcodizer] no media_url found out of:
""
2023-10-19T00:01:37.451Z WARN [vod2pod_rss::rss_transcodizer] links analyzed:
""
2023-10-19T00:01:37.451Z WARN [vod2pod_rss::rss_transcodizer] regex used:
"^(https?://)?.+\\.(mp3|mp4|wav|avi|mov|flv|wmv|mkv|aac|ogg|webm|3gp|3g2|asf|m4a|mpg|mpeg|ts|m3u|m3u8|pls)$"
2023-10-19T00:01:37.451Z DEBUG [vod2pod_rss::provider] using GenericProvider as provider
2023-10-19T00:01:37.451Z DEBUG [vod2pod_rss::rss_transcodizer] item title: 星際異攻隊聖誕特別篇！彩蛋滿滿！星爵又有家人了！ #星際異攻隊 #银 河护卫队
2023-10-19T00:01:37.452Z WARN [vod2pod_rss::rss_transcodizer] no media_url found out of:
""
2023-10-19T00:01:37.452Z WARN [vod2pod_rss::rss_transcodizer] links analyzed:
""
2023-10-19T00:01:37.452Z WARN [vod2pod_rss::rss_transcodizer] regex used:
"^(https?://)?.+\\.(mp3|mp4|wav|avi|mov|flv|wmv|mkv|aac|ogg|webm|3gp|3g2|asf|m4a|mpg|mpeg|ts|m3u|m3u8|pls)$"
2023-10-19T00:01:37.452Z DEBUG [vod2pod_rss::provider] using GenericProvider as provider
2023-10-19T00:01:37.452Z DEBUG [vod2pod_rss::rss_transcodizer] item title: 星戰《安多》！小人物大格局！更懂星戰精髓！#安多 #shorts
2023-10-19T00:01:37.453Z WARN [vod2pod_rss::rss_transcodizer] no media_url found out of:
""
app version: 1.0.2
issue description:
RSS feeds seem limited to about 50 items, which excludes old videos. Could a setting be added to increase the feed length?
E.g. a feed for https://www.youtube.com/@LastWeekTonight only goes back Oct 2021, rather than including the full list of videos that go back several more years.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.