lot of memory allocations becomes bottleneck

[intelpython]

lot of memory allocations becomes bottleneck

[Alexsandruss]

Memory allocations are expected especially during generation of synthetic datasets.
I can't add anything else without knowledge of what are you exactly running on this screenshot.
There is no variable or argument to control it.

[jkr0103]

Is it possible to split the "generation of synthetic datasets" and "actual benchmark execution" between two processes. My case is I am trying to run these benchmarking algorithms in SGX using gramine where we have memory constraints. Hence would like to know if synthetic datasets can be generated separately so that we do only benchmarks execution inside SGX.

[jkr0103]

sorry closed it by mistake

[napetrov]

Would be addressed with pre-fetch capability in this PR -#133