[Discussion] Unable to open /dev/kfd read-write: Permission denied when installing ROCm in distrobox

[wayneyaoo]

[Discussion] Unable to open /dev/kfd read-write: Permission denied when installing ROCm in distrobox

[89luca89]

Hi @wayneyaoo

Ensure you have crun installed and podman info shows that you're using crun as ociRuntime
This allows to share group access between host and guest

Then ensure you, on the host, are in the right groups, and you'll have the proper access to the device

Else, just use a rootful container

This will solve your problems

[wayneyaoo]

Hey @89luca89 I really appreciate it! My host user missing access to the device is the key... Not sure why I was not in render. After adding myself to the group it works. crun was already installed and picked up by podman.

For others that might hit this issue with AMD GPU, the above template file works fine (but it doesn't install clblast). Just make sure your host user has rw access to the /dev/kfd. Also after ollama 0.1.21, AMD GPU will be recognized automatically even if the installation script didn't say so (it'll mention "NVIDIA GPU is not found, ollama will work in CPU mode" but when it serves, it'll figure out the AMD GPU, given rocm and clblast are installed).