resource constrained notebooks

[determined-ai]

resource constrained notebooks

[vishnu2kmohan]

Hi @uniwuppes, greetings from a snowy New York!

I would like to host multiple notebooks on a single GPU however.

Sadly, this is not easy to support. That said, within the same notebook server, you can launch multiple kernels, but the GPUs themselves don't allow for strong isolation (absent advanced GPU virtualization techniques like Bitfusion, that carefully manage limits on GPU RAM, on a per-process basis, or by taking advantage of Multi-Instance GPU support that have recently become available with the A100s) so we don't recommend more than one active kernel (that needs to use the GPU(s)) at any given time.

[vishnu2kmohan]

@uniwuppes Let us know if you need any further information, or if we can close this issue. Thanks!

[tritolol]

Thanks for the explanation.