Giter Site home page Giter Site logo

anasty17 / mirror-leech-telegram-bot Goto Github PK

View Code? Open in Web Editor NEW
3.1K 53.0 4.6K 3.78 MB

Official Repository: Telegram bot which can download direct links, torrents, google drive, telegram document, any file/folder from rclone supported clouds, all yt-dlp supported sites and jdownloader supported sites, then upload them to google drive, telegram cloud or to one of rclone supported clouds

Home Page: https://t.me/mltb_official_channel

License: GNU General Public License v3.0

Dockerfile 0.03% Python 99.83% Shell 0.14%
mirror leech clone mega python qbittorrent pyrogram aria2c google-drive telegram-bot

mirror-leech-telegram-bot's Issues

not sure error or not, but what its mean

2021-11-29T04:46:50.731631+00:00 app[web.1]: 2021-11-29 04:46:50,731 - bot - INFO - Bot Started!
2021-11-29T04:46:58.661442+00:00 app[web.1]: 2021-11-29 04:46:58,661 - bot.helper.mirror_utils.download_utils.youtube_dl_download_helper - WARNING - [youtube] Cannot login to YouTube using username and password. Use --cookies-from-browser or --cookies for the authentication. See https://github.com/ytdl-org/youtube-dl#how-do-i-pass-cookies-to-youtube-dl for how to manually pass cookies
2021-11-29T04:47:31.029309+00:00 app[web.1]: 2021-11-29 04:47:31,029 - bot.helper.mirror_utils.download_utils.youtube_dl_download_helper - INFO - Downloading with YT-DL: https://www.youtube.com/watch?v=xOIAcvUsYNE&ab_channel=JonathanLiandi
2021-11-29T04:47:31.042577+00:00 app[web.1]: 2021-11-29 04:47:31,042 - bot.helper.mirror_utils.download_utils.youtube_dl_download_helper - WARNING - [youtube] Cannot login to YouTube using username and password. Use --cookies-from-browser or --cookies for the authentication. See https://github.com/ytdl-org/youtube-dl#how-do-i-pass-cookies-to-youtube-dl for how to manually pass cookies
2021-11-29T04:47:31.654914+00:00 app[web.1]: 2021-11-29 04:47:31,654 - bot.helper.mirror_utils.download_utils.youtube_dl_download_helper - WARNING - [youtube] Cannot login to YouTube using username and password. Use --cookies-from-browser or --cookies for the authentication. See https://github.com/ytdl-org/youtube-dl#how-do-i-pass-cookies-to-youtube-dl for how to manually pass cookies

Feature Request

In this mirror bot add Gplink bypass support like @Gautam1834 mirror bot (previous feature) now they added seperate bot for that

Stop duplicate not working

Log :

app[web.1]: 2021-11-24 08:01:24,620 - bot - INFO - https://api.droidontime.com/api/download/rosy/v5.2.1/vanilla
2021-11-24T08:01:24.621100+00:00 app[web.1]: 2021-11-24 08:01:24,620 - bot - INFO - No Direct link function found for https://api.droidontime.com/api/download/rosy/v5.2.1/vanilla
2021-11-24T08:01:24.632913+00:00 app[web.1]: 2021-11-24 08:01:24,632 - bot - INFO - Started: e85ad84c573ac7fb DIR:/usr/src/app/downloads/124 
2021-11-24T08:01:25.640769+00:00 app[web.1]: 2021-11-24 08:01:25,640 - bot - INFO - Checking File/Folder if already in Drive...
2021-11-24T08:01:26.154293+00:00 app[web.1]: Exception in thread Thread-14:
2021-11-24T08:01:26.154305+00:00 app[web.1]: Traceback (most recent call last):
2021-11-24T08:01:26.154306+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
2021-11-24T08:01:26.155406+00:00 app[web.1]:     self.run()
2021-11-24T08:01:26.155420+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 870, in run
2021-11-24T08:01:26.155612+00:00 app[web.1]:     self._target(*self._args, **self._kwargs)
2021-11-24T08:01:26.155626+00:00 app[web.1]:   File "/usr/src/app/bot/helper/mirror_utils/download_utils/aria2_download.py", line 28, in __onDownloadStarted
2021-11-24T08:01:26.155713+00:00 app[web.1]:     smsg, button = gdrive.drive_list(sname, True)
2021-11-24T08:01:26.155726+00:00 app[web.1]:   File "/usr/src/app/bot/helper/mirror_utils/upload_utils/gdriveTools.py", line 747, in drive_list
2021-11-24T08:01:26.155985+00:00 app[web.1]:     for n in self.get_recursive_list(file, parent_id)
2021-11-24T08:01:26.155998+00:00 app[web.1]:   File "/usr/src/app/bot/helper/mirror_utils/upload_utils/gdriveTools.py", line 602, in get_recursive_list
2021-11-24T08:01:26.156190+00:00 app[web.1]:     fileId=file.get("parents")[0],
2021-11-24T08:01:26.156229+00:00 app[web.1]: TypeError: 'NoneType' object is not subscriptable

Heroku Accounts Suspended

I deployed via Github action but still account suspended after 7 hour of deploy

Any way to prevent suspension??

I tried redeploy method with same name but still no luck...

Got some issue

  • When i do /leech i got this error, but file uploaded
    Log :
2021-11-30T06:57:03.166792+00:00 app[web.1]: Exception in thread Thread-5:
2021-11-30T06:57:03.166804+00:00 app[web.1]: Traceback (most recent call last):
2021-11-30T06:57:03.166820+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
2021-11-30T06:57:03.167059+00:00 app[web.1]:     self.run()
2021-11-30T06:57:03.167081+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 870, in run
2021-11-30T06:57:03.167272+00:00 app[web.1]:     self._target(*self._args, **self._kwargs)
2021-11-30T06:57:03.167301+00:00 app[web.1]:   File "/usr/src/app/bot/helper/mirror_utils/download_utils/aria2_download.py", line 21, in __onDownloadStarted
2021-11-30T06:57:03.167383+00:00 app[web.1]:     if STOP_DUPLICATE and dl is not None and not dl.getListener().isLeech:
2021-11-30T06:57:03.167416+00:00 app[web.1]: AttributeError: 'TgUploadStatus' object has no attribute 'getListener'
  • Stop duplicate not working
    Log :
2021-11-30T07:12:53.083576+00:00 app[web.1]: Exception in thread Thread-2:
2021-11-30T07:12:53.083606+00:00 app[web.1]: Traceback (most recent call last):
2021-11-30T07:12:53.083639+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
2021-11-30T07:12:53.085012+00:00 app[web.1]:     self.run()
2021-11-30T07:12:53.085093+00:00 app[web.1]:   File "/usr/lib/python3.8/threading.py", line 870, in run
2021-11-30T07:12:53.085642+00:00 app[web.1]:     self._target(*self._args, **self._kwargs)
2021-11-30T07:12:53.085711+00:00 app[web.1]:   File "/usr/src/app/bot/helper/mirror_utils/download_utils/aria2_download.py", line 21, in __onDownloadStarted
2021-11-30T07:12:53.086016+00:00 app[web.1]:     if STOP_DUPLICATE and dl is not None and not dl.getListener().isLeech:
2021-11-30T07:12:53.086136+00:00 app[web.1]: AttributeError: 'UploadStatus' object has no attribute 'getListener'

LINK : https://sourceforge.net/projects/gabutbuild/files/Simple/simplekernel-11.0-ginkgo-20211129-0740.zip/download

Path of Download_Dir

Dear sir,

I have encountered two problems. First, I use the VPS of buyvm, so I have a 256G hard disk mounted with the path: /mount, and the installation path of my mirrorbot is: /root/mirrorbot.
Problem 1: Mirrorbot can't recognize my mounted hard disk.

> Bot Uptime: 12h32m44s
> Total Disk Space: 9.78GB
> Used: 6.7GB |  Free: 2.56GB
> Upload: 3.18GB> Download: 3.94GB
> CPU: 0.0%> RAM: 63.1%> DISK: 72.4%
> Physical Cores: 1
> Total Cores: 1
> SWAP: 1024.0MB | Used: 21.3%
> memory total: 477.91mb 
> memory free: 176.46mb 
> memory used: 287.49mb 

Problem 2:
I changed the download path download _ dir = "/usr/src/app/downloads" to download _ dir = "/mount/gdrive/downloads"
I don't know if it can't be downloaded to the set folder because of the first question, and I can't find it in/usr/src/app/downloads.

In addition, thank you for developing this great tool!

Cloning Error

Some clones show: Error:'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
image
and sometimes it says that file/folder already exists, even tho it does not (works fine when STOP_DUPLICATE is false but then the utf-8 error show up), and sometimes the telegraph search result view button doesn't show up
image

features

I want make public bot it's mean anyone can use this without any authorised group

can you help me

Heroku RAM exceeded issue when mirroring multiple tasks at once

I usually use this bot from this repo for mirroring a task one at a time, I never found out about this issue.

But today, I tried to mirror two magnet links at once and when one of the task was completely uploaded, the bot was stuck. I tried it in my another bot, it was the same. And then I tried it with my friend's bots with the latest commit, and they were the same.

The log only gave this:
Error R14 (Memory quota exceeded)

There's nothing else mentioned, when the bot is stuck, the log doesn't show anything and I need to restart the dyno to fix this, but the problem will be still there if I try to mirror more than one tasks.

I don't know about how that was in older commits so I can't be sure what is the cause if it's from the repo. It can also be that heroku gives a less powerful server for free tier apps, I just want to make sure of this. It can also be something wrong in my part.

Thank you ๐Ÿ™

Upload not working through SA's

Hi..
I deployed bot via github workflow and added both token.pickle accounts.zip url in config.env & set use service account to "True" also added Google group (with same sa) to td with manger permission but upload won't happening. Btw upload works fine if I'm not using sa's. And my sa are fine (not banned or anything) so what I'm doing wrong here... please slove this
This is what log file shows:
2021-11-26 05:49:22,382 - bot - INFO - Generating USER_SESSION_STRING
2021-11-26 05:49:22,383 - root - WARNING - MEGA API KEY not provided!
2021-11-26 05:49:22,383 - root - WARNING - MEGA Credentials not provided!
2021-11-26 05:49:22,383 - root - WARNING - UPTOBOX_TOKEN not provided!
2021-11-26 05:49:26,743 - bot - INFO - Creating TELEGRAPH Account using 'duEFmSXa' name
2021-11-26 05:49:34,438 - apscheduler.scheduler - INFO - Scheduler started
2021-11-26 05:49:34,622 - bot - INFO - Bot Started!
2021-11-26 05:52:51,237 - bot - INFO - https://github.com/endeavouros-team/ISO/releases/download/1-EndeavourOS-ISO-releases-archive/endeavouros-2021.08.27-x86_64.iso
2021-11-26 05:52:51,328 - bot - INFO - Started: 05eb832921ab9b60 DIR:/usr/src/app/downloads/2448
2021-11-26 05:53:28,626 - bot - INFO - Download completed: endeavouros-2021.08.27-x86_64.iso
2021-11-26 05:53:28,635 - bot - INFO - Upload Name: endeavouros-2021.08.27-x86_64.iso
2021-11-26 05:53:28,636 - bot.helper.mirror_utils.upload_utils.gdriveTools - INFO - Authorizing with 97.json service account

Gdrive upload not working

Deployed your repo tried both CLI and git workflow but couldn't get gdrive upload working. Tried uploading token.pickle file to cloud to get link which was then added to token.pickle field in config.env, also tried uploding same to git and the deploying it using git workflow but still no good. Need help to get gdrive upload working, Its throwing error and I am unable to determine what's the problem here.

gdtot Status

Is it possible to add some kind of status message while gdtot link is being processed?
Now only after it is processed, it shows the 'cloning' status msg.

Feature request: queue system for telegram files

When we mirror Telegram files it should download certain limit of videos until those are finished others should be in queue. Just like how we keep limit on aria2 concurrent download

Example: if we mirror 10 Telegram files 5 should download simultaneously and remaining will be in queue

bot is not downloading torrent but able to download direct links.

i deployed bot to heroku.
first clone and done git checkout heroku
then copied my cred. token.pickel file
then followed you given by you
pushed and added following configs

REQUIRED CONFIG

BOT_TOKEN = ""
GDRIVE_FOLDER_ID = ""
OWNER_ID =
DOWNLOAD_DIR = "/usr/src/app/downloads"
DOWNLOAD_STATUS_UPDATE_INTERVAL = 7
AUTO_DELETE_MESSAGE_DURATION = 20
IS_TEAM_DRIVE = ""
TELEGRAM_API =
TELEGRAM_HASH = ""
BASE_URL_OF_BOT = "" # Web Link, Required for (Heroku) to avoid sleep or use worker

when i use /leech or /mirror with magnet links
it stuck at collecting metadata

is there anything i missed
please help

Feature Request: please add cUrl downloading capability

There are lots of websites that provides dynamic links for download. So if i get the download link from my pc and use it on the bot to leech/mirror they won't work! Because the ip address is different. I generated the download link with my pc(one ip address)
And the bot got ip address (another) from heroku. So the download will not start.

But these problem is solved if we get the cUrl of the file that we want to download using a Firefox extension.(https://youtu.be/YQ-GL8wkdDg) check out this video if you can. You will get the idea if you already haven't.

So my request is please add the cUrl mirror and leeching feature.

And i added the code which is used to download cUrl on colab.
Screenshot_20211121-094734_Chrome

Bot Commands are not changing

Sorry to interrupt you once again but I came to know that I changed bot commands from bot_commands.py file and redeployed the app but still old commands are working and new commands are not replaced.

Leech settings and thumbnails not persistent

Upon dyno restart or even restarting the bot on private server, causes the the thumbs and leech settings to be removed.
DATABASE_URL given and working fine because I'm already using qbit selection.
I don't think I have made any errors on my end, thus issuing this issue.

Feature Request : Seed till certain Ratio

As a lot of us are on private trackers, we often end up leeching because it's convenient to use the bot to upload to TDs.
When running on VPS, it would be nice if we have a seed command with the required ratio as an argument so that we don't end up doing a 'Hit and Run'.
It is a niche feature, so don't expect you to work on it at all.
But given it might be directly possible through qbit api, I hope it would relatively easier to implement.

bot can't upload

image
What could the error might be sir? Idk if I did something wrong

Error R15 (Memory quota vastly exceeded) using qbmirror

here's the log
2021-11-28T04:27:34.890760+00:00 app[web.1]: 2021-11-28 04:27:34,890 - bot - INFO - https://henilreleases.gq/0:/Weathering.with.You.2019.1080p.BluRay.REMUX.AVC.MULTi.DTS-HD.MA.5.1-HENiL.mkv
2021-11-28T04:27:40.493997+00:00 heroku[web.1]: Process running mem=549M(107.4%)
2021-11-28T04:27:40.496966+00:00 heroku[web.1]: Error R14 (Memory quota exceeded)
2021-11-28T04:27:50.211536+00:00 heroku[web.1]: Process running mem=1279M(250.0%)
2021-11-28T04:27:50.660719+00:00 heroku[web.1]: Error R15 (Memory quota vastly exceeded)
2021-11-28T04:27:50.662796+00:00 heroku[web.1]: Stopping process with SIGKILL
2021-11-28T04:27:50.898135+00:00 heroku[web.1]: Process exited with status 137
2021-11-28T04:27:50.706479+00:00 heroku[web.1]: Process running mem=1243M(242.9%)
2021-11-28T04:27:50.737971+00:00 heroku[web.1]: Error R15 (Memory quota vastly exceeded)
2021-11-28T04:27:50.744258+00:00 heroku[web.1]: Stopping process with SIGKILL
2021-11-28T04:27:50.957641+00:00 heroku[web.1]: State changed from up to crashed

Add gdtot support for heroku branch

I tried to deploy master branch using heroku cli method bot says one or more vars are missing and crashes immediately even if I've filled all required vars and some optional vars correctly. So I'm trying to say do you have plans for adding gdtot support for heroku branch ?

Feature Req: Replace Filters concept with DB

Replace Filters : replace the specific set of word with the new word via filter while leeching /mirror (only for single file now)

ex- [xyzXD] qwe.mp3 changes to [abcd] qwe.mp3. here added replace filter to change words i.e. xyzXD to abcd

example working repo to help

### OR

Add something to change specific words from file while leeching

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.