Giter Site home page Giter Site logo

Comments (5)

kou1okada avatar kou1okada commented on August 25, 2024

I already use -T3 -t1 of wget options at L1431 for benchmark-mirrors subcommand which means:

$ wget --help | grep -E '^\s*(-T|-t)'
  -t,  --tries=NUMBER              set number of retries to NUMBER (0 unlimits)
  -T,  --timeout=SECONDS           set all timeout values to SECONDS

But -T option seems no-effective for the site which is healthy network connection but too slow transfer.

Here is my whole result:

$ time apt-cyg benchmark-parallel-mirrors-list
0m8.689s        http://cygwin.mirror.constant.com/
0m8.454s        https://cygwin.mirror.constant.com/
0m7.239s        https://mirrors.huaweicloud.com/cygwin/
0m9.179s        https://cygwin.mirrors.hoobly.com/
0m13.529s       https://mirror.clientvps.com/cygwin/
0m13.002s       https://polish-mirror.evolution-host.com/cygwin/
0m5.361s        http://mirrors.xmission.com/cygwin/
0m15.085s       http://cygwin.mirrors.hoobly.com/
0m14.357s       http://mirror.team-cymru.com/cygwin/
0m6.908s        https://mirrors.xmission.com/cygwin/
0m7.309s        http://mirror.clarkson.edu/cygwin/
0m7.372s        https://mirror.clarkson.edu/cygwin/
0m7.893s        https://mirrors.rit.edu/cygwin/
0m9.260s        http://www.gtlib.gatech.edu/pub/cygwin/
0m15.076s       ftp://mirrors.xmission.com/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: http://mirror-hk.koddos.net/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m7.780s        http://mirror.cs.vt.edu/pub/cygwin/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirrors.netix.net/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
Warning: benchmark failed with wget exitcode 4: Network failure.: https://mirror-hk.koddos.net/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m10.682s       http://mirror.koddos.net/cygwin/
0m13.171s       ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirror.internode.on.net/pub/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m16.269s       https://mirror.koddos.net/cygwin/
0m11.873s       https://mirrors.netix.net/cygwin/
0m8.096s        ftp://mirrors.sonic.net/cygwin/
0m7.473s        http://mirrors.sonic.net/cygwin/
0m9.414s        http://cygwin.mirror.uk.sargasso.net/
0m10.704s       https://cygwin.mirror.uk.sargasso.net/
0m14.777s       http://mirror.internode.on.net/pub/cygwin/
0m8.426s        https://mirrors.sonic.net/cygwin/
0m24.290s       http://mirrors.netix.net/cygwin/
0m10.462s       ftp://mirrors.syringanetworks.net/cygwin/
0m13.848s       http://mirror.steadfast.net/cygwin/
0m7.639s        http://cygwin.cathedral-networks.org/
0m7.983s        https://cygwin.cathedral-networks.org/
0m12.534s       http://mirrors.syringanetworks.net/cygwin/
0m15.505s       https://mirror.steadfast.net/cygwin/
0m13.806s       ftp://ftp.twaren.net/Unix/sourceware.org/cygwin/
0m7.673s        ftp://mirrors.dotsrc.org/mirrors/cygwin/
0m6.065s        http://mirrors.dotsrc.org/cygwin/
0m5.393s        ftp://ftp.kr.freebsd.org/pub/cygwin.com/cygwin/
0m6.129s        https://ftp.kr.freebsd.org/pub/cygwin.com/cygwin/
0m8.366s        https://mirrors.dotsrc.org/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.mirrorservice.org/sites/sourceware.org/pub/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirror.easyname.at/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m10.078s       http://www.mirrorservice.org/sites/sourceware.org/pub/cygwin/
0m8.503s        https://www.mirrorservice.org/sites/sourceware.org/pub/cygwin/
0m16.034s       http://mirrors.kernel.org/sourceware/cygwin/
0m5.201s        http://mirror.aarnet.edu.au/pub/sourceware/cygwin/
0m6.822s        https://mirror.aarnet.edu.au/pub/sourceware/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.byfly.by/pub/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m19.437s       https://mirrors.kernel.org/sourceware/cygwin/
0m16.301s       https://mirror.easyname.at/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirror.datacenter.by/pub/mirrors/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m20.025s       http://mirror.easyname.at/cygwin/
0m13.178s       https://linorg.usp.br/cygwin/
0m14.530s       http://linorg.usp.br/cygwin/
0m14.712s       http://ftp.byfly.by/pub/cygwin/
0m13.676s       https://ftp.byfly.by/pub/cygwin/
0m7.814s        http://muug.ca/mirror/cygwin/
0m5.889s        https://muug.ca/mirror/cygwin/
0m12.890s       http://mirror.datacenter.by/pub/mirrors/cygwin/
0m6.395s        ftp://ftp.muug.ca/mirror/cygwin/
0m7.030s        http://cygwin.mirror.rafal.ca/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirror.csclub.uwaterloo.ca/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m15.848s       https://mirror.datacenter.by/pub/mirrors/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: http://mirror.csclub.uwaterloo.ca/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
Warning: benchmark failed with wget exitcode 4: Network failure.: https://mirror.csclub.uwaterloo.ca/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m7.246s        http://mirror.cpsc.ucalgary.ca/mirror/cygwin.com/
0m10.731s       ftp://cygwin.mirror.rafal.ca/pub/cygwin/
0m8.762s        https://mirror.cpsc.ucalgary.ca/mirror/cygwin.com/
0m5.279s        https://mirrors.sjtug.sjtu.edu.cn/cygwin/
0m4.855s        https://mirrors.ustc.edu.cn/cygwin/
0m5.689s        http://mirrors.ustc.edu.cn/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://mirror.checkdomain.de/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m9.617s        http://mirror.checkdomain.de/cygwin/
0m14.727s       https://mirrors.neusoft.edu.cn/cygwin/
0m10.810s       https://mirror.checkdomain.de/cygwin/
0m8.839s        ftp://ftp.fau.de/cygwin/
0m7.736s        http://ftp.fau.de/cygwin/
0m9.431s        https://ftp.fau.de/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp-stud.hs-esslingen.de/pub/Mirrors/sources.redhat.com/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m12.428s       http://www.gutscheinrausch.de/mirror/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.inf.tu-dresden.de/software/windows/cygwin32/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m18.334s       ftp://linux.rz.ruhr-uni-bochum.de/cygwin/
0m22.376s       http://ftp-stud.hs-esslingen.de/pub/Mirrors/sources.redhat.com/cygwin/
0m17.881s       https://linux.rz.ruhr-uni-bochum.de/download/cygwin/
0m17.909s       http://ftp.inf.tu-dresden.de/software/windows/cygwin32/
0m7.845s        https://ftp.inf.tu-dresden.de/software/windows/cygwin32/
0m30.972s       https://www.gutscheinrausch.de/mirror/cygwin/
0m25.410s       http://linux.rz.ruhr-uni-bochum.de/download/cygwin/
0m28.095s       https://ftp-stud.hs-esslingen.de/pub/Mirrors/sources.redhat.com/cygwin/
0m11.812s       https://cygwin.mbwarez.dk/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.lip6.fr/pub/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m15.163s       http://cygwin.mbwarez.dk/
Warning: benchmark failed with wget exitcode 4: Network failure.: http://mirrors.neusoft.edu.cn/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m6.698s        http://ftp.lip6.fr/pub/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.ntua.gr/pub/pc/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.fsn.hu/pub/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m11.102s       ftp://ftp.funet.fi/pub/mirrors/sourceware.org/pub/cygwin/
0m9.679s        https://ftp.lip6.fr/pub/cygwin/
0m13.534s       https://mirrors.filigrane-technologie.fr/cygwin/
0m1.595s        ftp://ftp.jaist.ac.jp/pub/cygwin/
0m1.437s        http://ftp.jaist.ac.jp/pub/cygwin/
0m1.939s        https://ftp.jaist.ac.jp/pub/cygwin/
0m6.711s        http://sourceware.mirror.garr.it/cygwin/
0m7.828s        https://sourceware.mirror.garr.it/cygwin/
0m2.769s        ftp://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.495s        http://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.918s        https://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.166s        ftp://ftp.iij.ad.jp/pub/cygwin/
0m1.940s        http://ftp.iij.ad.jp/pub/cygwin/
0m13.877s       https://mirror.isoc.org.il/pub/cygwin/
0m2.591s        https://ftp.iij.ad.jp/pub/cygwin/
0m16.609s       http://mirror.isoc.org.il/pub/cygwin/
0m20.789s       http://ftp.fsn.hu/pub/cygwin/
0m7.245s        ftp://ftp.kaist.ac.kr/cygwin/
0m6.941s        https://ftp.kaist.ac.kr/cygwin/
0m6.583s        http://mirror.lagoon.nc/cygwin/
0m6.854s        https://mirror.lagoon.nc/cygwin/
0m9.726s        ftp://mirror.lagoon.nc/cygwin/
0m7.774s        ftp://ftp.snt.utwente.nl/pub/software/cygwin/
0m5.972s        http://ftp.snt.utwente.nl/pub/software/cygwin/
0m28.389s       https://ftp.fsn.hu/pub/cygwin/
0m7.124s        https://ftp.snt.utwente.nl/pub/software/cygwin/
0m7.539s        http://cygwin.uib.no/
0m9.521s        http://mirror.terrahost.no/cygwin/
0m7.128s        https://cygwin.uib.no/
0m6.928s        http://cygwin.viem-it.no/
0m10.433s       https://mirror.terrahost.no/cygwin/
0m6.633s        https://cygwin.viem-it.no/
0m5.698s        http://ucmirror.canterbury.ac.nz/cygwin/
0m4.963s        ftp://mirror.rise.ph/cygwin/cygwin/
0m3.939s        http://mirror.rise.ph/cygwin/cygwin/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.eq.uc.pt/pub/software/pc/prog/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m6.507s        http://ftp.eq.uc.pt/software/pc/prog/cygwin/
0m7.862s        https://ftp.eq.uc.pt/software/pc/prog/cygwin/
0m8.091s        http://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m7.136s        http://ftp.acc.umu.se/mirror/cygwin/
0m9.788s        ftp://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m7.285s        https://ftp.acc.umu.se/mirror/cygwin/
0m8.564s        ftp://ftp.acc.umu.se/mirror/cygwin/
0m7.100s        http://download.nus.edu.sg/mirror/cygwin/
0m12.974s       https://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m5.467s        http://cygwin.mirror.globo.tech/
Warning: benchmark failed with wget exitcode 4: Network failure.: ftp://ftp.is.co.za/mirrors/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
0m7.909s        https://download.nus.edu.sg/mirror/cygwin/
0m6.690s        https://cygwin.mirror.globo.tech/
0m14.508s       http://ftp.is.co.za/mirrors/cygwin/
Finished benchmark.
========================================
Sorted result.
0m30.972s       https://www.gutscheinrausch.de/mirror/cygwin/
0m28.389s       https://ftp.fsn.hu/pub/cygwin/
0m28.095s       https://ftp-stud.hs-esslingen.de/pub/Mirrors/sources.redhat.com/cygwin/
0m25.410s       http://linux.rz.ruhr-uni-bochum.de/download/cygwin/
0m24.290s       http://mirrors.netix.net/cygwin/
0m22.376s       http://ftp-stud.hs-esslingen.de/pub/Mirrors/sources.redhat.com/cygwin/
0m20.789s       http://ftp.fsn.hu/pub/cygwin/
0m20.025s       http://mirror.easyname.at/cygwin/
0m19.437s       https://mirrors.kernel.org/sourceware/cygwin/
0m18.334s       ftp://linux.rz.ruhr-uni-bochum.de/cygwin/
0m17.909s       http://ftp.inf.tu-dresden.de/software/windows/cygwin32/
0m17.881s       https://linux.rz.ruhr-uni-bochum.de/download/cygwin/
0m16.609s       http://mirror.isoc.org.il/pub/cygwin/
0m16.301s       https://mirror.easyname.at/cygwin/
0m16.269s       https://mirror.koddos.net/cygwin/
0m16.034s       http://mirrors.kernel.org/sourceware/cygwin/
0m15.848s       https://mirror.datacenter.by/pub/mirrors/cygwin/
0m15.505s       https://mirror.steadfast.net/cygwin/
0m15.163s       http://cygwin.mbwarez.dk/
0m15.085s       http://cygwin.mirrors.hoobly.com/
0m15.076s       ftp://mirrors.xmission.com/cygwin/
0m14.777s       http://mirror.internode.on.net/pub/cygwin/
0m14.727s       https://mirrors.neusoft.edu.cn/cygwin/
0m14.712s       http://ftp.byfly.by/pub/cygwin/
0m14.530s       http://linorg.usp.br/cygwin/
0m14.508s       http://ftp.is.co.za/mirrors/cygwin/
0m14.357s       http://mirror.team-cymru.com/cygwin/
0m13.877s       https://mirror.isoc.org.il/pub/cygwin/
0m13.848s       http://mirror.steadfast.net/cygwin/
0m13.806s       ftp://ftp.twaren.net/Unix/sourceware.org/cygwin/
0m13.676s       https://ftp.byfly.by/pub/cygwin/
0m13.534s       https://mirrors.filigrane-technologie.fr/cygwin/
0m13.529s       https://mirror.clientvps.com/cygwin/
0m13.178s       https://linorg.usp.br/cygwin/
0m13.171s       ftp://mirror.cs.vt.edu/pub/cygwin/cygwin/
0m13.002s       https://polish-mirror.evolution-host.com/cygwin/
0m12.974s       https://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m12.890s       http://mirror.datacenter.by/pub/mirrors/cygwin/
0m12.534s       http://mirrors.syringanetworks.net/cygwin/
0m12.428s       http://www.gutscheinrausch.de/mirror/cygwin/
0m11.873s       https://mirrors.netix.net/cygwin/
0m11.812s       https://cygwin.mbwarez.dk/
0m11.102s       ftp://ftp.funet.fi/pub/mirrors/sourceware.org/pub/cygwin/
0m10.810s       https://mirror.checkdomain.de/cygwin/
0m10.731s       ftp://cygwin.mirror.rafal.ca/pub/cygwin/
0m10.704s       https://cygwin.mirror.uk.sargasso.net/
0m10.682s       http://mirror.koddos.net/cygwin/
0m10.462s       ftp://mirrors.syringanetworks.net/cygwin/
0m10.433s       https://mirror.terrahost.no/cygwin/
0m10.078s       http://www.mirrorservice.org/sites/sourceware.org/pub/cygwin/
0m9.788s        ftp://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m9.726s        ftp://mirror.lagoon.nc/cygwin/
0m9.679s        https://ftp.lip6.fr/pub/cygwin/
0m9.617s        http://mirror.checkdomain.de/cygwin/
0m9.521s        http://mirror.terrahost.no/cygwin/
0m9.431s        https://ftp.fau.de/cygwin/
0m9.414s        http://cygwin.mirror.uk.sargasso.net/
0m9.260s        http://www.gtlib.gatech.edu/pub/cygwin/
0m9.179s        https://cygwin.mirrors.hoobly.com/
0m8.839s        ftp://ftp.fau.de/cygwin/
0m8.762s        https://mirror.cpsc.ucalgary.ca/mirror/cygwin.com/
0m8.689s        http://cygwin.mirror.constant.com/
0m8.564s        ftp://ftp.acc.umu.se/mirror/cygwin/
0m8.503s        https://www.mirrorservice.org/sites/sourceware.org/pub/cygwin/
0m8.454s        https://cygwin.mirror.constant.com/
0m8.426s        https://mirrors.sonic.net/cygwin/
0m8.366s        https://mirrors.dotsrc.org/cygwin/
0m8.096s        ftp://mirrors.sonic.net/cygwin/
0m8.091s        http://ftp.rnl.tecnico.ulisboa.pt/pub/cygwin/
0m7.983s        https://cygwin.cathedral-networks.org/
0m7.909s        https://download.nus.edu.sg/mirror/cygwin/
0m7.893s        https://mirrors.rit.edu/cygwin/
0m7.862s        https://ftp.eq.uc.pt/software/pc/prog/cygwin/
0m7.845s        https://ftp.inf.tu-dresden.de/software/windows/cygwin32/
0m7.828s        https://sourceware.mirror.garr.it/cygwin/
0m7.814s        http://muug.ca/mirror/cygwin/
0m7.780s        http://mirror.cs.vt.edu/pub/cygwin/cygwin/
0m7.774s        ftp://ftp.snt.utwente.nl/pub/software/cygwin/
0m7.736s        http://ftp.fau.de/cygwin/
0m7.673s        ftp://mirrors.dotsrc.org/mirrors/cygwin/
0m7.639s        http://cygwin.cathedral-networks.org/
0m7.539s        http://cygwin.uib.no/
0m7.473s        http://mirrors.sonic.net/cygwin/
0m7.372s        https://mirror.clarkson.edu/cygwin/
0m7.309s        http://mirror.clarkson.edu/cygwin/
0m7.285s        https://ftp.acc.umu.se/mirror/cygwin/
0m7.246s        http://mirror.cpsc.ucalgary.ca/mirror/cygwin.com/
0m7.245s        ftp://ftp.kaist.ac.kr/cygwin/
0m7.239s        https://mirrors.huaweicloud.com/cygwin/
0m7.136s        http://ftp.acc.umu.se/mirror/cygwin/
0m7.128s        https://cygwin.uib.no/
0m7.124s        https://ftp.snt.utwente.nl/pub/software/cygwin/
0m7.100s        http://download.nus.edu.sg/mirror/cygwin/
0m7.030s        http://cygwin.mirror.rafal.ca/
0m6.941s        https://ftp.kaist.ac.kr/cygwin/
0m6.928s        http://cygwin.viem-it.no/
0m6.908s        https://mirrors.xmission.com/cygwin/
0m6.854s        https://mirror.lagoon.nc/cygwin/
0m6.822s        https://mirror.aarnet.edu.au/pub/sourceware/cygwin/
0m6.711s        http://sourceware.mirror.garr.it/cygwin/
0m6.698s        http://ftp.lip6.fr/pub/cygwin/
0m6.690s        https://cygwin.mirror.globo.tech/
0m6.633s        https://cygwin.viem-it.no/
0m6.583s        http://mirror.lagoon.nc/cygwin/
0m6.507s        http://ftp.eq.uc.pt/software/pc/prog/cygwin/
0m6.395s        ftp://ftp.muug.ca/mirror/cygwin/
0m6.129s        https://ftp.kr.freebsd.org/pub/cygwin.com/cygwin/
0m6.065s        http://mirrors.dotsrc.org/cygwin/
0m5.972s        http://ftp.snt.utwente.nl/pub/software/cygwin/
0m5.889s        https://muug.ca/mirror/cygwin/
0m5.698s        http://ucmirror.canterbury.ac.nz/cygwin/
0m5.689s        http://mirrors.ustc.edu.cn/cygwin/
0m5.467s        http://cygwin.mirror.globo.tech/
0m5.393s        ftp://ftp.kr.freebsd.org/pub/cygwin.com/cygwin/
0m5.361s        http://mirrors.xmission.com/cygwin/
0m5.279s        https://mirrors.sjtug.sjtu.edu.cn/cygwin/
0m5.201s        http://mirror.aarnet.edu.au/pub/sourceware/cygwin/
0m4.963s        ftp://mirror.rise.ph/cygwin/cygwin/
0m4.855s        https://mirrors.ustc.edu.cn/cygwin/
0m3.939s        http://mirror.rise.ph/cygwin/cygwin/
0m2.918s        https://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.769s        ftp://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.591s        https://ftp.iij.ad.jp/pub/cygwin/
0m2.495s        http://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.166s        ftp://ftp.iij.ad.jp/pub/cygwin/
0m1.940s        http://ftp.iij.ad.jp/pub/cygwin/
0m1.939s        https://ftp.jaist.ac.jp/pub/cygwin/
0m1.595s        ftp://ftp.jaist.ac.jp/pub/cygwin/
0m1.437s        http://ftp.jaist.ac.jp/pub/cygwin/

real    3m39.168s
user    1m12.124s
sys     2m8.565s

from apt-cyg.

kou1okada avatar kou1okada commented on August 25, 2024

It is a pity that it takes more than 3 minutes.

Increasing the LESSER_PARALLEL_MAX_JOBS environment variable will help you a little, but the effect is very limited.

$ time LESSER_PALESSER_PARALLEL_MAX_JOBS=128 apt-cyg benchmark-parallel-mirrors-list

...

real    2m3.826s
user    1m4.195s
sys     1m42.101s

from apt-cyg.

kou1okada avatar kou1okada commented on August 25, 2024

If you can limit the top domains, you should be able to save significant time.

$ time apt-cyg mirrors-list | grep -E '\.jp/' | xargs apt-cyg benchmark-parallel-mirrors
0m1.777s        ftp://ftp.jaist.ac.jp/pub/cygwin/
0m1.786s        http://ftp.jaist.ac.jp/pub/cygwin/
0m2.513s        https://ftp.jaist.ac.jp/pub/cygwin/
0m3.182s        ftp://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.886s        http://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.449s        ftp://ftp.iij.ad.jp/pub/cygwin/
0m2.069s        http://ftp.iij.ad.jp/pub/cygwin/
0m2.431s        https://ftp.iij.ad.jp/pub/cygwin/
0m4.734s        https://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
Finished benchmark.
========================================
Sorted result.
0m4.734s        https://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m3.182s        ftp://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.886s        http://ftp.yz.yamagata-u.ac.jp/pub/cygwin/
0m2.513s        https://ftp.jaist.ac.jp/pub/cygwin/
0m2.449s        ftp://ftp.iij.ad.jp/pub/cygwin/
0m2.431s        https://ftp.iij.ad.jp/pub/cygwin/
0m2.069s        http://ftp.iij.ad.jp/pub/cygwin/
0m1.786s        http://ftp.jaist.ac.jp/pub/cygwin/
0m1.777s        ftp://ftp.jaist.ac.jp/pub/cygwin/

real    0m9.827s
user    0m3.607s
sys     0m6.730s

from apt-cyg.

WyntrHeart avatar WyntrHeart commented on August 25, 2024

I see. I did try only benchmarking mirrors located in North America, but that still took several minutes (I didn't time it so idk exactly how long). I suppose I could try manually making a list of servers that are closest to my location

from apt-cyg.

kou1okada avatar kou1okada commented on August 25, 2024

Hmmm, using the timeout command can accelerate it but too slow fork in cygwin makes bottleneck.

git --diff
diff --git a/apt-cyg b/apt-cyg
index 0dcf04f..ce77b5d 100755
--- a/apt-cyg
+++ b/apt-cyg
@@ -1428,7 +1428,7 @@ function apt-cyg-benchmark-mirrors ()
 {
   local mirror result exitcode
   for mirror; do
-    result="$( { time wget -qO/dev/null -T3 -t 1 "${mirror%/}/$arch/setup.bz2"; } 2>&1 )"
+    result="$( { time timeout 3s wget -qO/dev/null -T3 -t 1 "${mirror%/}/$arch/setup.bz2"; } 2>&1 )"
     exitcode=$?
     if [ $exitcode -ne 0 ];then
       warning "benchmark failed with wget exitcode $exitcode: $(wget-exitstatus $exitcode): $1"
$ time LESSER_PARALLEL_MAX_JOBS=128 apt-cyg benchmark-parallel-mirrors-list

...

Warning: benchmark failed with wget exitcode 124: Unknown errors.: http://ftp.is.co.za/mirrors/cygwin/
at : /home/kou/local/bin/apt-cyg: apt-cyg-benchmark-mirrors: 1434
Finished benchmark.
========================================
Sorted result.
0m2.942s        ftp://ftp.iij.ad.jp/pub/cygwin/
0m2.277s        https://ftp.jaist.ac.jp/pub/cygwin/
0m2.271s        https://ftp.iij.ad.jp/pub/cygwin/
0m1.874s        http://ftp.jaist.ac.jp/pub/cygwin/

real    0m56.917s
user    0m33.741s
sys     0m44.666s

from apt-cyg.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.