viral-medialab/stable_diffusion_server

Runs your own Stable Diffusion v1.4 API with Flask & Docker

Stable Diffusion API

Runs your own Stable Diffusion v1.4 API with Flask & Docker

Requirements:

• NVIDIA GPU with CUDA installed & >10GB memory
• Ubunutu 20.04 (this can be adjusted in Dockerfile if you are using a different OS)
• Huggingface Access Token

To Start the Server:

1. git clone https://github.com/viral-medialab/stable_diffusion_server.git
2. sh setup.sh
3. In line 34 of the Dockerfile, replace <TOKEN> with your Huggingface Access Token
4. docker build --tag sd_server .
5. docker run -d -p 3000:3000 sd_server The server should now be running at http://<your_external_ip>:3000/

To Generate an Image from Text:

• Pass your prompt as query string ('?prompt=') to the server
• When calling the server from a browser, be sure to replace spaces with '%20'
• Example Prompt: "Impressionist painting of dog wearing party hat."
  • Resulting url: http://<your_external_ip>:3000/?prompt=impressionist%20painting%20of%20dog%20wearing%20party%20hat
  • Wait ~30 sec for image generation and return
  • 

The foundation of this repo was built by following Lulia Turc's article.

stable_diffusion_server's Issues

Docker Container Status: Exited(1)

Using docker desktop on windows 10 and running Ubuntu 20.04.5 LTS on WSL2 on Windows 10 with Gigabyte GeForce RTX 3070 GAMING OC 8G.
Followed your Readme and got up to step 5 without any issues until running "docker run -d -p 3000:3000 sd_server"
I checked what the problem was and docker desktop shows that the container is not running. This was the error:

2022-12-12 17:28:01 The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling transformers.utils.move_cache().
0it [00:00, ?it/s]1
2022-12-12 17:28:02 Traceback (most recent call last):
2022-12-12 17:28:02 File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2022-12-12 17:28:02 return _run_code(code, main_globals, None,
2022-12-12 17:28:02 File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2022-12-12 17:28:02 exec(code, run_globals)
2022-12-12 17:28:02 File "/stable_diffusion_server/app.py", line 13, in
2022-12-12 17:28:02 assert torch.cuda.is_available()
2022-12-12 17:28:02 AssertionError
2022-12-12 17:28:36 Traceback (most recent call last):
2022-12-12 17:28:36 File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2022-12-12 17:28:36 return _run_code(code, main_globals, None,
2022-12-12 17:28:36 File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2022-12-12 17:28:36 exec(code, run_globals)
2022-12-12 17:28:36 File "/stable_diffusion_server/app.py", line 13, in
2022-12-12 17:28:36 assert torch.cuda.is_available()
2022-12-12 17:28:36 AssertionError
2022-12-12 17:28:01 Moving 0 files to the new cache system

Can you help me solve this issue? Thanks

docker file not running

I have problem with docker file. It requires extension for visual code studio. Even after i install docker extension its still asking wants docker extension.please share me steps to resolve my issue.Thank you.