Comments (2)
Good catch! Thanks a lot :)
It looks like the memory leak happens in the predictive model which figures out what GEMM kernel to generate given some input shapes. This routine is called once per shape, so hopefully it shouldn't happen at every GEMM call but rather at every non-cached GEMM call, i.e., every time a new shape is encountered.
Nonetheless, this could be a big problem for applications that use repeated GEMM calls with many different shapes, such as some tiled linear algebra algorithm (like SVD).
from triton.
Closing this because ISAAC was updated to Triton. There may still be memory leaks though; may reopen later.
from triton.
Related Issues (20)
- Seems mistake in setup.py HOT 1
- bfloat16 of fused attention seems have bug HOT 2
- Possible to use WMMA `.b1` instructions? HOT 1
- AttributeError("'AnnAssign' object has no attribute 'targets'") HOT 1
- [Bug] Compiler error in 06-fused-attention.py
- Fused Attention FP8 correctness on L20(Ada GPU) HOT 1
- What impact does changing the kernel shape's divisibility value have?
- Does Triton have a roadmap plan? HOT 1
- FP8 Casting Tensor Size Alignment Error on AMD MI210 HOT 2
- Output dtype of 09-persistent-matmul.py
- Worse performance on `H100` than `RTX3090`
- [Bug] Assertion `idx < size()' failed. HOT 7
- Seems like these slides are missing, if possible, would you mind update the links or re-upload the files?
- Should @core.extern be part of the libdevice interface? HOT 1
- Cannot find 2.0.0.dev20221202 version HOT 2
- make error
- FlexAttention Segmentation Fault HOT 2
- What is the use of divisibility in coalesce pass
- triton build failing to access https://tritonlang.blob.core.windows.net/llvm-builds/ with HTTP Error 409 HOT 17
- Confusion about memory of pointers HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from triton.