Comments (4)
from gogrepoc.
Thanks for responding.
I will try to find some external way to rate limit just this script, maybe with domain based QoS or something.
I'm still interested in the argument to set the number of workers, but even that might not be necessary if download resuming works. Downloading one file at a time would mean only one part has to be restarted and more parts may have downloaded successfully before an interruption.
from gogrepoc.
Also if you point me to the lines where the HTTP requests for the "chunks" are happening then I might be able to implement this and PR it if it works.
Apparently it's easy to implement rate limiting with the python requests module; You just put a sleep between GET requests for chunks so that your overall rate will not exceed chunk_size / sleep_time
.
from gogrepoc.
from gogrepoc.
Related Issues (20)
- Please add non-empty return code on errors HOT 1
- Download everything? HOT 2
- How to manually create cookie file? HOT 1
- Problem logging in HOT 7
- Orphaning dir fails because path already exists HOT 1
- High memory usage when downloading HOT 1
- Games that corrupt the manifest DAT file HOT 8
- savedir at the end of the command string fails to use path when following -os -lang or -skipfiles HOT 3
- Unwanted languages downloaded HOT 6
- Clean function tries to orphan Windows hidden files on external hard drive.
- gogrepoc downloaded and named the folder for Jedi Knight Dark Forces 2 as 'Repblic Commando Copy 3'. HOT 1
- Latest commits broke the script HOT 14
- "no md5 data found for" Error for (nearly) all .sh files HOT 2
- Wishlist: Downloading ONE language by preference HOT 3
- Possibility to add an option to download only games and ignore patches? HOT 2
- Cyberpunk oddities HOT 7
- Suggestion: Allow an executable version of the python script.
- GOGRepoC cannot find the serial key(s) for the game "X4: Foundations".
- Can't download Atom RPG HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gogrepoc.