Downloads libonnxruntime.so.1.17.3 from pyke cache, but tries to load 1.18.1

[zopieux]

Downloads libonnxruntime.so.1.17.3 from pyke cache, but tries to load 1.18.1

[zopieux]

Impressive turn-around time, just wanted to show some gratitude for that awesome lib. 🚀

[decahedron1]

Fixed in v2.0.0-rc.4 - cc @isaac-mcfadyen

[zopieux]

Also having this issue - guessing it might be related to commit 8f8bbfb?

Hm, thanks. The thing I said above is specifically what is documented there and seemingly not happening: 8f8bbfb#diff-d2be1711b3546c95dd42f4622bd1e8a3c46f5e9975d7d36312fa194fe0449895R199

[isaac-mcfadyen]

I also just noticed

ort/ort-sys/build.rs

Line 139 in 8f8bbfb

let versioned_dy = out_dir.join("libonnxruntime.so.1.17.3");

in build.rs... might be related?

EDIT: I can confirm that this is the issue. I pulled the repo locally and modified it to 1.18.1 and it now compiles and works fine.

[zopieux]

Ah thanks, couldn't find where that damn version was even referenced. Looks like the issue is indeed in ort-sys.

[isaac-mcfadyen]

Also having this issue - guessing it might be related to commit 8f8bbfb?

[zopieux]

I think this goes deeper: the detection behavior to pick between CUDA 11 and 12 seems to be broken, because regardless of whether I build this in pytorch:2.3.1-cuda11 or pytorch:2.3.1-cuda12, libonnxruntime_providers_cuda.so expects libcublasLt.so.12.

[isaac-mcfadyen]

Fixed in v2.0.0-rc.4 - cc @isaac-mcfadyen

Amazing, thank you so much for the quick fix! ❤️