rbuels/http-range-fetcher

request-merging fetch manager for doing large numbers of HTTP range requests

http-range-fetcher's Issues

1.2.4 is on NPM but not on git repo

https://www.npmjs.com/package/http-range-fetcher is at 1.2.4

https://github.com/rbuels/http-range-fetcher/tags has no 1.2.4

I saw this because looking at dependencies I see that conventional-changelog-angular is included as a "runtime dependency" somewhere down the line still which b227857 was meant to fix

Flag to ignore cache controls

Apparently some people can have poorly configured servers, and sometimes configuring servers is hard, so possibly having a flag to ignore cache controls could be worth it

Ref GMOD/jbrowse#1418 (comment)

mysterious additional fetch beyond end of file

Observed in the wild in jbrowse, a very specific request pattern triggered an extra range request past the end of the file.

const globalRangeCache = new HttpRangeFetcher({
  fetch: binaryRangeFetch,
  size: 500 * 1024 ** 2, // 500MiB
  chunkSize: 128 * 124, // strange size
  maxFetchSize: 100 * 1024 ** 2, // 100MiB
  minimumTTL: 24 * 60 * 60 * 1000, // 1 day
})

console-logs.txt

Stats cache can result in undefined due to LRU evacuation

The stats cache is an LRU so stats can be evacuated before they are being attempted to be used

Xref GMOD/jbrowse#1473

Hard requirement on availability of Content-Length produces confusing errors under CORS

Usage of http-range-fetcher in our code requires Content-Length or Content-Range headers and if it is unavailable it produces hard to understand errors like this exchange

scottcain: @cmdcolin is there a bug with small vcf files? When I load an indexed vcf file via the web interface as a local file, it works fine, but when I put it in the config or load it as a remote url, I get a message error decompressing block undefined at 0 (length 65536) Error: unknown compression method Of interest is that the error message refers to a length of 65536 when the actual length of the file is 2248.

This error was also left open related to this
GMOD/jbrowse#1356