wget crashes when trying to downloading db

[fephyfofum]

wget crashes when trying to downloading db

[Cactusolo]

Hi @blubbundbla,

I have come across similar issue as you described. But I have usedcurl -C option to rescue/continued a previous file transfer at the given offset. It worked for me.

Because the file itself is large, so you have to "-C" a couple time until it's done.

Note: please man curl at your running environment to make sure the function has this feature.

Good luck!

Miao

[mkandziora]

Hi,
thank you for the advice. I tried using the -c option, but the connection crashes after a few seconds. I literally would need to redo the command 200 times.
I will probably try the phlawd_db_maker. I just wanted to let you know that the download of the pre-made db is not really working.
Martha

[Cactusolo]

I’m sorry it’s not working on your side. Anyway, I’m trying all my experiences to help you.

Maybe it’s some regulation on your institution which not encourage people to download huge files.

Just make sure it’s “-C” (cap C), and It would took me 4-5 times in my case. Also I think “curl” also has a “--retry” feature.

Other way, maybe running a bash script, keep trying with combination of "-C" and “--retry” options until it's complete :)

I have tried “phlawd_db_maker”, see here.

[blackrim]

Hi folks,
Is it unable to continue the download?

[Cactusolo]

@blackrim It works on my side previously. Have not tired recently.

Miao

[mkandziora]

@blackrim I tried it on different machines (all linux) and with different internet connections, as I thought it might be a problem on my site. It crashes approximately every 15sec. It continues the download with the -c function, but only 20x, after that, it stops, due to too many re-tries. When I restart it then it still continues, but it just makes the whole download unfeasible with 20GB.

[blackrim]

OK, hm. Are you able to construct one with phlawd_db_maker?

…

On Sun, Feb 3, 2019 at 11:02 AM Martha Kandziora ***@***.***> wrote: @blackrim I tried it on different machines (all linux) and with different internet connections, as I thought it might be a problem on my site. It crashes approximately every 15sec. It continues the download with the -c function, but only 20x, after that, it stops, due to too many re-tries. When I restart it then it still continues, but it just makes the whole download unfeasible with 20GB. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[mkandziora]

Yes, I was able to construct one using phlawd_db_maker.

[blackrim]

great! yeah, not sure how to solve the other one but I will look into it

…

On Mon, Feb 4, 2019 at 1:35 PM Martha Kandziora ***@***.***> wrote: Yes, I was able to construct one using phlawd_db_maker. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#26 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAJzKUcy6MtQh9CDox_gAuxC9b_hcNzhks5vKH1zgaJpZM4aT3os> .