Comments (8)
I solved the issue by disabling --api. It was enabled by default. I actually dont know what it does exacly but i disabled that and it worked.
Thank you that fixed my Unet not showing up.
from stable-diffusion-webui-tensorrt.
I've documented that --api
can cause issues when exporting in the readme now. I'll close as this seems to be resolved. Feel free to reopen is you still encounter issues.
from stable-diffusion-webui-tensorrt.
It looks like your engine profiles didn't get written into the model.json file, I suspect that if you open the model.json file it will empty.
You can try deleting all files in the Unet-trt folder including the model.json file and then rebuild your trt engines.
from stable-diffusion-webui-tensorrt.
It looks like your engine profiles didn't get written into the model.json file, I suspect that if you open the model.json file it will empty.
You can try deleting all files in the Unet-trt folder including the model.json file and then rebuild your trt engines.
I tried but this time it gaves me this error
ONNX-Runtime is not installed, so constant folding may be suboptimal or not work at all.
Consider installing ONNX-Runtime: C:\Users\DjSpa\AppData\Roaming\StabilityMatrix\Packages\stable-diffusion-webui\venv\Scripts\python.exe -m pip install onnxruntime
[I] Folding Constants | Pass 1
[!] Module: 'onnxruntime.tools.symbolic_shape_infer' is required but could not be imported.
Note: Error was: No module named 'onnxruntime'
You can set POLYGRAPHY_AUTOINSTALL_DEPS=1 in your environment variables to allow Polygraphy to automatically install missing modules.
[I] Total Nodes | Original: 8992, After Folding: 6216 | 2776 Nodes Folded
[I] Folding Constants | Pass 2
[W] colored module is not installed, will not use colors when logging. To enable colors, please install the colored module: python3 -m pip install colored
[W] Inference failed. You may want to try enabling partitioning to see better results. Note: Error was:
No module named 'onnxruntime'
[!] Module: 'onnxruntime.tools.symbolic_shape_infer' is required but could not be imported.
Note: Error was: No module named 'onnxruntime'
You can set POLYGRAPHY_AUTOINSTALL_DEPS=1 in your environment variables to allow Polygraphy to automatically install missing modules.
[I] Total Nodes | Original: 6216, After Folding: 6152 | 64 Nodes Folded
[I] Folding Constants | Pass 3
[W] colored module is not installed, will not use colors when logging. To enable colors, please install the colored module: python3 -m pip install colored
[W] Inference failed. You may want to try enabling partitioning to see better results. Note: Error was:
No module named 'onnxruntime'
[!] Module: 'onnxruntime.tools.symbolic_shape_infer' is required but could not be imported.
Note: Error was: No module named 'onnxruntime'
You can set POLYGRAPHY_AUTOINSTALL_DEPS=1 in your environment variables to allow Polygraphy to automatically install missing modules.
[I] Total Nodes | Original: 6152, After Folding: 6152 | 0 Nodes Folded
I'll try to delete all the files that comes with tensort-rt in''venv'' and will reinstall it. Thanx for reply.
from stable-diffusion-webui-tensorrt.
Unless the engine generation actually failed, those errors are more likely just warnings and things should still work as expected.
from stable-diffusion-webui-tensorrt.
Unless the engine generation actually failed, those errors are more likely just warnings and things should still work as expected.
Didn't know that thank you π but still no luck, You are right about ''model json'' file. It is still empty.I have no clue what the problem and will never understand probably:) Thank you anyway
--I forgot the say this. When i trying to export an engine it gaves this error--
''[INFO]: TensorRT engine found. Skipping build. You can enable Force Export in the Advanced Settings to force a rebuild if needed.''
I am sending this maybe its bug or something. It says found but no engines under the profile sections.
from stable-diffusion-webui-tensorrt.
I solved the issue by disabling --api. It was enabled by default. I actually dont know what it does exacly but i disabled that and it worked.
from stable-diffusion-webui-tensorrt.
''[INFO]: TensorRT engine found. Skipping build. You can enable Force Export in the Advanced Settings to force a rebuild if needed.''
To avoid this, you'll need to delete the engine from Unet-trt.
I have not yet reproduced this issue. I'll work on this as soon as possible, but due to the amount of issues and limited time this might need some time to be fixed.
from stable-diffusion-webui-tensorrt.
Related Issues (20)
- ModuleNotFoundError: No module named 'launch' HOT 2
- after install tensorRT, loading with this errorγγγjson.decoder.JSONDecodeError: Expecting value: line 2875 column 36 (char 193761)
- [E] 1: Myelin (Myelin error from unknown graph) [E] 4: The timing cache will not be used! HOT 2
- TensorRT does not load automatically after startup
- Trying to load models throws OutofMemoryError on Ubuntu
- TensorRT gives a Runtime Error when Positive prompt value is 150 and Negative prompt value is 75.
- Does tensorRT support direct use of apis, and what are the parameters? HOT 1
- how to generate json config file in the LoRA tab. HOT 1
- [branch: Controlnet_V2] ONNX IR model version conflict, how do i downgrade?
- [E] 3: getPluginCreator could not find plugin: InstanceNormalization_TRT version: 1 when building engine with latest TRT_VERSION="10.0.0b6"
- No config file found for You can generate it in the LoRA tab. HOT 3
- Advise to add promt token check in warning report
- [Feature Request] Add a Command Line Interface for the exporter process.
- AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'get_profile_shape' HOT 2
- How to process a batch of images with ControlNet TensorRT in img2img ?
- Latest version of automatic1111 wont start with this extension installed. HOT 2
- AttributeError: 'NoneType' object has no attribute 'device_memory' HOT 12
- Error Code 3: API Usage Error (Parameter check failed
- Export LoRA to onnx depending on cyberrealistic_v31 can't fit to v1-5-pruned-emaonly_cnet_1846e6c3c239531e.trt
- TensorRT doesn't install on fresh A1111 install on Ubuntu, stuck at install after copy/paste de git link HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stable-diffusion-webui-tensorrt.