Comments (4)
Yikes!
For example, this is one using the yiffymix_v43 two days ago.
To clarify: Were you still on 3.x two days ago?
I believe this is the model: https://civitai.com/models/129996/easyfluff
Based on the description there, this model uses v-prediction. I noticed a couple issues in our handling:
- We aren't correctly determining checkpoint scheduler prediction on import, so the model is set as epsilon.
- When you go and change it to v-pred, it doesn't change the config file path, which is required to convert the model to diffusers and use it.
- Even if you manually fix the config file path, if the model was converted once before, it will not be converted again. The diffusers conversion cache must be emptied to trigger the conversion again.
Once I manually fix the config file path (stable-diffusion/v1-inference-v.yaml
is the correct value) and delete the model conversion cache, I get better images. Using CLIP Skip 2 and CFG Rescale 0.7 per the model page:
So no longer totally broken, but still not right. They all have this grainy look. I tried enabling upcast_attention
, which I think is related to v-pred and re-converting - this didn't seem to change anything.
At this point, I'm not sure how to proceed further.
@lstein Any ideas for fixing the root issue?
I think there are clear solutions for each of the 3 issues I noted:
- Figure out how to determine the prediction type from the state dict for SD1. Right now, it doesn't try, jsut defaults to epsilon. I don't know how to do this.
- Do not hardcode the ckpt config file paths unless the user explicitly sets it. When we convert, if there is no config file path, we determine the right config file using the same logic the probe uses.
- Invalidate the ckpt conversion cache if a change to a model record means it would convert differently. We could simply invalidate the conversion cache on any model config change. I think that is reasonable, though it is less efficient.
from invokeai.
I was still on 3.x two days ago, yeah. I had used an old installer I still had on my desktop at the time.
The model you're using is correct, but just to check, is that using the config file provided with the model? Not sure if that might be causing the grainy look there or if there's indeed still an issue.
from invokeai.
No, I didn't notice there was a config file provided. Unfortunately, using it doesn't change the outputs - still grainy. I made sure to re-convert the model.
In v3, we used the diffusers ckpt conversion logic with some fixes. Those fixes were upstreamed to diffusers, and in v4 we moved back to the standard diffusers conversion. I suspect we are missing an arg in the conversion calls, or maybe diffusers has a bug.
from invokeai.
@JantDarvus, sorry for this unrelated question:
Can you run InvokeAI 4 properly with a GTX 1070 ?
I have the same GPU and I use the Comfy UI with no issues.
I was looking at InvokeAI, but they don't recommend this card.
https://invoke-ai.github.io/InvokeAI/installation/INSTALL_REQUIREMENTS/
Can you run SDXL models with it ?
from invokeai.
Related Issues (20)
- there is no option 4 in the invoke.bat starting menu HOT 2
- [bug]: ConnectionError when offline HOT 2
- [enhancement]: Better prompt adherence with Ella HOT 1
- Problem installing: version does not satisfy requirement rich + no matching distribution found for rich[bug]: HOT 1
- [bug]: xinsir/controlnet-tile-sdxl-1.0 is not probed correctly when scanned from a directory
- [enhancement]: Image graph does not contain random seeds used to generate an image (Could be a bug)
- [enhancement]:on send2trash exception there should be a force delete option HOT 1
- [bug]: Sliced Attention: `TypeError: '>' not supported between instances of 'str' and 'int'` HOT 1
- [enhancement]: Canvas - Zoom 100% (actual size) of the image/canvas HOT 2
- [enhancement]: Please support FLUX.1 HOT 53
- [bug]: Unable to install any upscaling models in Starter Models HOT 1
- [BUG]: Manual InvokeAI installation fails on metadata (pyproject.toml) HOT 5
- [enhancement]: Magic Prompts
- [bug]: UserWarning: 1Torch was not compiled with flash attention. HOT 5
- [bug]: Very slow with IPadapter (SDXL) HOT 3
- [bug]: docker/run.sh fails to parse the GPU_DRIVER parameter into the `profile` variable unless you delete commented lines above
- [enhancement]: Model Preview Image HOT 1
- [enhancement]: Rate and Sort option for gallery
- [bug]: Images saved as full.png rather than the actual file name HOT 1
- [bug]: Skeleton images are not converted correctly in openpose-sdxl HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from invokeai.