Met with cuda out of memory when I am testing the model

[yinboc]

Met with cuda out of memory when I am testing the model

[sangjun04]

try reducing the batch size.

[xuejiancai]

i met the same error(cuda oom) when test rdn-liif.
did you solve this problem?

[Lovegood-1]

I have 4 GPU. But when I run code on GPU:2 ,I run this 'CUDA_VISIBLE_DEVICES=2 python demo.py --input 246.jpg --model rdn-liif.pth --resolution 2560,1440 --output output.png --gpu 0' and get 'cuda out of memory'. Than I try 'CUDA_VISIBLE_DEVICES=2 python demo.py --input 246.jpg --model rdn-liif.pth --resolution 1440,2560 --output output.png --gpu 2'. It work!!!

[Irina51244]

try reducing the batch size.

I tried to reduce the batch size to 1, but it didn't work.

[Irina51244]

I have 4 GPU. But when I run code on GPU:2 ,I run this 'CUDA_VISIBLE_DEVICES=2 python demo.py --input 246.jpg --model rdn-liif.pth --resolution 2560,1440 --output output.png --gpu 0' and get 'cuda out of memory'. Than I try 'CUDA_VISIBLE_DEVICES=2 python demo.py --input 246.jpg --model rdn-liif.pth --resolution 1440,2560 --output output.png --gpu 2'. It work!!!

I set the number of GPU to '1', but it still used GPU'0'.
RuntimeError: CUDA out of memory. Tried to allocate 4.46 GiB (GPU 0; 11.00 GiB total capacity; 6.84 GiB already allocated; 1.27 GiB free; 7.97 GiB reserved in total by PyTorch)