AssertionError: assert q.is_cuda and k.is_cuda and v.is_cuda

[magics-lab]

AssertionError: assert q.is_cuda and k.is_cuda and v.is_cuda

[pjsample]

I was able to fix this issue by installing Triton directly from the Github repo. The version is 2.1, rather than 2.0 that pip installs.

https://github.com/openai/triton#install-from-source

[Zhihan1996]

@pjsample Thank you very much for provide the solution! I have updated the README accordingly.

[UronicAcid]

My Triton is version 2.1.0, but the same errors still occur.

[JiaweiMao12135]

My Triton is version 2.1.0, but the same errors still occur.

I'm experiencing the same issues, have you solved yours yet?

[QAQ1551QAQ]

这是来自QQ邮箱的假期自动回复邮件。   您好，我最近正在休假中，无法亲自回复您的邮件。我将在假期结束后，尽快给您回复。