Comments (16)
We do plan porting to other platforms soon. We just want to first have one very solid implementation and CUDA happened to be the best/easiest to do it first.
from bend.
Will it be possible to run with zluda? https://github.com/vosen/ZLUDA (CUDA on AMD GPUs)
from bend.
Is your feature request related to a problem? Please describe. I have an AMD GPU so I cannot take advantage of the CUDA running.
Describe the solution you'd like I would love either an Open-CL or a Vulkan running mode (or both) if possible.
Describe alternatives you've considered I have tried compiling to CUDA and then running a translation layer to Open-CL but the performance isn't what I expected.
Additional context None.
I think you mean AMD ROCM. ROCM is AMD's alternative to CUDA for nvidia. vulkan is for older GPUs. so finally it should look like
bend run-ro <file.hvm> # uses the ROCM interpreter (massively parallel)
from bend.
I think you mean AMD ROCM. ROCM is AMD's alternative to CUDA for nvidia. vulkan is for older GPUs. so finally it should look like
bend run-ro <file.hvm> # uses the ROCM interpreter (massively parallel)
You may be mistaken- Vulkan as a standard was released 8 years ago, and modern drivers only coming out in 2019 or later. (https://en.wikipedia.org/wiki/Vulkan)
On ROCm, it is not what we want. ROCm is a software stack specifically for AMD Graphics cards. CUDA, on the other hand is not a software stack. AMD's equivalent to Nvidia's CUDA is indeed OpenCL, or alternatively Vulkan. Vulkan specializes in graphics, where OpenCL is more general.
In any case fwiw OpenCL support would be appreciated, as it also would have the benefit of supporting intel GPUs.
from bend.
hoping for metal support (it seemed like the cpu benchmarks were already on mac)
from bend.
I cannot wait for Metal support! 😇
from bend.
Vulkan would be great, in my experience Vulkan and ROCm are about the same actually and Vulkan has much broader support. I think it's the future personally once someone writes a nice wrapper around it that takes the role of CUDA or ROCm instead of being more generalized, I am not sure if it is the case with Vulkan vs CUDA I'd like to know honestly same with Vulkan and OpenVINO or whatever it is. But if Vulkan is so good at least on AMD, seems like no brainier just to implement that, not sure what the benefits of ROCm would be other than ease of development perhaps please correct me but seems to be my perspective as a user
from bend.
...and Metal? 🥹
Is that this ticket too or does it need another one?
from bend.
We do plan porting to other platforms soon. We just want to first have one very solid implementation and CUDA happened to be the best/easiest to do it first.
If that is the case, I recommend reading the documentation of HIP Porting Guide as you write your CUDA. Main difference is to account for possible warp size of 64 instead of always assuming 32 and you are almost good to go with ROCm support
from bend.
...and Metal? 🥹
Yes
from bend.
I think you mean AMD ROCM. ROCM is AMD's alternative to CUDA for nvidia. vulkan is for older GPUs. so finally it should look like
bend run-ro <file.hvm> # uses the ROCM interpreter (massively parallel)
You may be mistaken- Vulkan as a standard was released 8 years ago, and modern drivers only coming out in 2019 or later. (https://en.wikipedia.org/wiki/Vulkan)
On ROCm, it is not what we want. ROCm is a software stack specifically for AMD Graphics cards. CUDA, on the other hand is not a software stack. AMD's equivalent to Nvidia's CUDA is indeed OpenCL, or alternatively Vulkan. Vulkan specializes in graphics, where OpenCL is more general.
In any case fwiw OpenCL support would be appreciated, as it also would have the benefit of supporting intel GPUs.
AMD vulkan (derived from mantle) api, is not limited to AMD GPUs, one can use it with NVIDIA's Nsight suite of development tools where as nvidia CUDA is designed specifically for nvidia GPUs, just like ROCM was designed with AMD GPUs in mind. So if you want a low level access to the gpu which isn't specifically designed with any gpu vendor in mind, you would choose vulkan api, if you want to specifically target AMD GPUs (especially the newer ones) ROCM is a better choice. However for this project I do support you prioritizing vulkan api over others because that would not only give a low level access to the GPU but it supports all 3 vendors. Intel does list https://www.intel.com/content/www/us/en/support/articles/000005524/graphics.html vulkan api as a supported api for their GPUs.
Vendor | OpenCL | Vulkan API | ROCM | CUDA |
---|---|---|---|---|
Intel | Yes | Yes | No | No |
Nvidia | Yes | Yes | No | Yes |
AMD | Yes | Yes | Yes | No |
Technology | Open Source |
---|---|
ROCm | Yes |
CUDA | No |
Vulkan API | Yes |
OpenCL | Yes |
from bend.
I think you mean AMD ROCM. ROCM is AMD's alternative to CUDA for nvidia. vulkan is for older GPUs. so finally it should look like
bend run-ro <file.hvm> # uses the ROCM interpreter (massively parallel)
You may be mistaken- Vulkan as a standard was released 8 years ago, and modern drivers only coming out in 2019 or later. (https://en.wikipedia.org/wiki/Vulkan)
On ROCm, it is not what we want. ROCm is a software stack specifically for AMD Graphics cards. CUDA, on the other hand is not a software stack. AMD's equivalent to Nvidia's CUDA is indeed OpenCL, or alternatively Vulkan. Vulkan specializes in graphics, where OpenCL is more general.
In any case fwiw OpenCL support would be appreciated, as it also would have the benefit of supporting intel GPUs.AMD vulkan (derived from mantle) api, is not limited to AMD GPUs, one can use it with NVIDIA's Nsight suite of development tools where as nvidia CUDA is designed specifically for nvidia GPUs, just like ROCM was designed with AMD GPUs in mind. So if you want a low level access to the gpu which isn't specifically designed with any gpu vendor in mind, you would choose vulkan api, if you want to specifically target AMD GPUs (especially the newer ones) ROCM is a better choice. However for this project I do support you prioritizing vulkan api over others because that would not only give a low level access to the GPU but it supports all 3 vendors. Intel does list https://www.intel.com/content/www/us/en/support/articles/000005524/graphics.html vulkan api as a supported api for their GPUs.
Vendor OpenCL Vulkan API ROCM CUDA
Intel Yes Yes No No
Nvidia Yes Yes No Yes
AMD Yes Yes Yes No
Technology Open Source
ROCm Yes
CUDA No
Vulkan API Yes
OpenCL Yes
I was going to say I thought Vulkan would be the best option not this ROCm but what do I know!
from bend.
No worries! Very impressive project, I am looking forward to using it in the future.
from bend.
This request belongs to HVM ?
from bend.
I have an AMD gpu, so for the moment using the CUDA interpreter is off the table, but would the C interpreter still be usable?
from bend.
I think that things like support for different runtimes would benefit from becoming a tracking issue. OpenCL is probably the best next step, as it has the best support across platforms. While vulkan has a compute element, it is notoriously a pain to write, and it seems slower than OpenCL from what I can find.
from bend.
Related Issues (20)
- Converting between numbers and strings HOT 2
- HVM output reader thread not ending after HVM returns HOT 4
- Wrong reduction HOT 8
- Can't gen-cu directly HOT 2
- HVM install failing when compiling the Cuda runtime HOT 4
- HVM PARSE_ERROR expecting operator when copying the Map/get builtins.bend examples HOT 1
- Put constructor tags behind a reference in num-scott adt encoding
- Improve error message when the input file is not found
- Don't warn on unused generated definitions
- Make `with` clauses take a bind and an argument
- Evaluate using Profile-Guided Optimization (PGO) for the compiler HOT 2
- (Request) Regular Expression library
- (Request) Run in both the CPU and GPU at the same time HOT 1
- Running with all optimizations on is slower than running with the default optimizations HOT 2
- Mechanism to make recursive monadic functions not loop HOT 3
- Add syntax for a builtin tree type
- Pipe/Thread operator
- Error compiling cu generated code HOT 2
- Doesn't find CUDA on Nvidia PRIME Laptop HOT 3
- (Request) String-casting numbers for print() HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bend.