Full Info Provided - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

[nvidia]

Full Info Provided - RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

[contentis]

Thank you for your contribution! The readme has been updated now to inform users that SDXL depends on a fix in the dev branch.

[FurkanGozukara]

6.14 it / second

This means nothing without your hardware specs and test case details

RTX 3090 ti 1024x1024

I am preparing a big video @camoody1

that small video is just like a preview

also i am preparing auto downloader of pre compiled tensor RT

[FurkanGozukara]

Automatic1111 DEV version is working for SDXL

the speed is amazing

6.14 it / second

[nailz420]

6.14 it / second

This means nothing without your hardware specs and test case details

[camoody1]

Your video said nothing at all about the error you have in the post title.

Thank you for wasting my time.

[FurkanGozukara]

Watch below video to learn how to compile SDXL TensorRT and use it - it includes both manual and auto way

RTX Acceleration Quick Tutorial With Auto Installer V2 SDXL - Tensor RT

[maxious]

FWIW the resolution to the "RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu" error is disable the "medvram"/"lowvram" optimisation https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Optimizations

[FurkanGozukara]

FWIW the resolution to the "RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu" error is disable the "medvram"/"lowvram" optimisation https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Optimizations

important i will tell this too in big tutorial

still for sdxl you need dev branch