Note on improving download speed

[sambacha]

Note on improving download speed

[wmitsuda]

Did you notice significant improvement on time spent to download the sourcify repo? Just curious.

I'm on mac, it seems the default in my machine is 8MB:

$ sysctl kern.ipc.maxsockbuf
kern.ipc.maxsockbuf: 8388608

[sambacha]

Will have to benchmark to get specifics, OSX configuration is recommended to have about 30-35% more than what is needed per the documentation provided above

Benchmarking would be interesting, maybe will create a dummy repo with a small data set that way its reproducible, wdyt?

[wmitsuda]

Would be good, I don't have a linux machine so I can't reproduce, but if this is confirmed to improve download speed we can add this recommendation on build instructions, the raw sourcify repo is quite big right now (~11GB) and increasing.

[sambacha]

Would be good, I don't have a linux machine so I can't reproduce, but if this is confirmed to improve download speed we can add this recommendation on build instructions, the raw sourcify repo is quite big right now (~11GB) and increasing.

I found this very relevant repo: https://github.com/ConsenSys/ipfs-lookup-measurement
with latency for content retrieval graphed here

Also just to clarify, not using the flat store (using badger) and pub sub, any other important flags?

Cheers