multi / specific gpu?

[nvidia]

multi / specific gpu?

[contentis]

Currently, multi-GPU is not supported. It will always assume to run on cuda device 0, which probably caused the illegal memory access.

If you set CUDA_VISIBLE_DEVICES=1 and then launch webui it should work. But it will only work on one GPU at a time I assume.
Depending on how many users are interested in multi GPU I could scope it.

[KirillSamoilenko]

this worked, thanks!

[contentis]

Closing as this seems to be resolved. Feel free to reopen in case you encounter further issues.

[korziner]

Yes, many users are interested in multi GPU, please scope it.

[dadadaing10]

Hello, I used set CUDA_VISIBLE_DEVICES= 0, 1
set COMMANDLINE_ARGS=--device-id 1, but Stable Diffusion still shows error.

Question 1.I paste the webui-user.bat parameters here:
@echo off
set PYTHON_CUDA_ALLOC_CONF=max_split_size_mb:32
setPYTHON=
set GIT=
setVENV_DIR=
set COMMANDLINE_ARGS=--medvram --precision full --no-half --opt-sub-quad-attention --opt-split-attention-v1 --disable-nan-check
setCUDA_VISIBLE_DEVICES= 0, 1
set COMMANDLINE_ARGS=--device-id 1

call webui.bat

Question 2.Disabling the graphics card results in a CUDA error.

Thanks