Reduce memory pressure of the caching to the minimum

[hicolour]

Reduce memory pressure of the caching to the minimum

[simerplaha]

Yep detailed documentation on cache configurations is missing. We should really document each cache config with performance benchmarks when turned off vs on.

Everything is configurable, so you should be able to configure caching from being very high to almost no caching.

For now, similar to how you've disabled caching with segmentConfigOverride in your code, you can try the same for sortedIndex, hashIndex, binarySearchIndex, bloomFilter and valuesConfig (find them in DefaultConfigs)

Set the following for all the above blocks.

case action: IOAction.DecompressAction => IOStrategy.SynchronisedIO(cacheOnAccess = false)

Just a note, in your settings above you've disabled caching opened files with this setting.

.copyWithFileOpenIOStrategy(IOStrategy.AsyncIO(cacheOnAccess = false))

So every thread that tries to access a file would open a new java.nio.FileChannel. Unless you have an extreme use-case I would set this to cacheOnAccess = true so there are less concurrently opened FileChannels for a file.