Comments (4)
rupeshs
commented on May 24, 2024
Not planning to add support for this ChilloutMix NSFW model. Please try DreamShaper XL in the LCM-LoRA mode, select lcm-lcm-lora-sdxl :
from fastsdcpu.
Micraow
commented on May 24, 2024
OK. I have tried that and found my ram is too small. I have 8GB RAM and 13GB SWAP, but it always fails with an OOM. I noticed that you offered an int8 model, and that works well. Could you please share the script to quantize?
P. S. Happy 2024!
from fastsdcpu.
rupeshs
commented on May 24, 2024
Happy New Year!
You can use lcm-openvino-converter https://github.com/rupeshs/lcm-openvino-converter
Also, pass --int8 to optimum-cli command to compress model weight.
from fastsdcpu.
Micraow
commented on May 24, 2024
Well, I wonder if there are other ways to prune? like using nncf?
And if fastsdcpu supports using other normal LoRa?
Also, I have a question on quantization: Should we turn every weight into int8 or we should leave some in fp16?
from fastsdcpu.
Related Issues (20)
- [Error]Fail to run HOT 7
- Problems Starting the Linux start script HOT 1
- Use openvino intel cpu plugin HOT 1
- High ram usage causes segmentation fault HOT 1
- Any plans to add an API? HOT 1
- How can I change the maximum memory size that can be used by this model? HOT 2
- How to use Dreamshaper xl turbo with fastsdcpu ? HOT 3
- installation on windows HOT 2
- not able to get openvino running on pi 5 HOT 5
- IP adaptater Openvino HOT 2
- Python 3.9 required HOT 2
- Problem running the latest desktop gui HOT 4
- Web-frontend LCM-openVINO crashed hard HOT 1
- trying to install on android device with Termux HOT 1
- Error while trying to generate photo first time HOT 1
- Feature Request: Ability to 'refresh/reload' various dropdowns without restarting FastSD CPU
- no torch 2.0.1 for arm64 HOT 1
- Installation Issues: Incompatible torch and openvino Versions in install.bat HOT 3
- Acsessing web ui from lan HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastsdcpu.