beyondhyx / gpu_poor Goto Github PK
View Code? Open in Web Editor NEWThis project forked from rahulschand/gpu_poor
Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization
Home Page: https://rahulschand.github.io/gpu_poor/