mikael-alafriz-deel/lucid-sonic-dreams

lucid-sonic-dreams's Issues

Installing in Ubuntu 20.04 ?

Hi
I tried now for hours to install Lucid Sonic Dreams in Ubuntu 20.04. How to install it correctly so that it works ? I tried it with anaconda but no luck....a little desperate now !
Update: Installed everything without errors. Used the setup.py to install dependencies. But now i am stuck. Where and how to execute this:

from lucidsonicdreams import show_styles

Show valid default style names.
show_styles()

or this ?

"from lucidsonicdreams import LucidSonicDream

L = LucidSonicDream(song = 'song.mp3',
style = 'abstract photos')

L.hallucinate(file_name = 'song.mp4') " ??

Can someone enlighten me please ?

No module named 'dnnlib'

I kept running into the error below using the basic example script.

Traceback (most recent call last):
  File "d:\Python\LSD\first.py", line 1, in <module>
    from lucidsonicdreams import LucidSonicDream
  File "D:\python\LSD\lsd\lib\site-packages\lucidsonicdreams\__init__.py", line 1, in <module>
    from .main import *
  File "D:\python\LSD\lsd\lib\site-packages\lucidsonicdreams\main.py", line 32, in <module>
    import dnnlib
ModuleNotFoundError: No module named 'dnnlib'

changed the main.py line 32-33 from

import dnnlib
from dnnlib.tflib.tfutil import * 

to

from stylegan2 import dnnlib
from stylegan2.dnnlib.tflib.tfutil import * 

on my computer and it seems to have fixed that issue

where to place .pkl model files?

Hi,

Thanks for the fantastic repo,

I really want to drop a custom .pkl model file into LucidSonicDreams and it isn't obvious to me where I should put it? I'm working in Colab for the time being.

Thanks,

Mark

support for generation of video of any resolution

I found this fork of Sylegan2-ada this can generate videos with any resolution with the help of padding. Maybe this can be used in lucid sonic dreams instead of the original stylegan-ada repo,

Add argument for setting truncated value for StyleGAN

Currently the default truncated value is used, but for different models and varying effects, setting this value is important.

Incompatible python versions

Hi

It doesn't work with python versions:

• Python 3.7.9

Hallucinating Errors

This is such a cool project. Please have a look at this.

Errors:

Hallucinating...

  0%|                                                                                                                                                                                                          | 0/4405 [00:00<?, ?it/s]2021-03-28 19:04:09.816474: E tensorflow/core/common_runtime/executor.cc:642] Executor failed to create kernel. Invalid argument: Conv2DCustomBackpropInputOp only supports NHWC.
         [[{{node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose}}]]
  0%|                                                                                                                                                                                                          | 0/4405 [00:02<?, ?it/s]
Traceback (most recent call last):
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call
    return fn(*args)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn
    target_list, run_metadata)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC.
         [[{{node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "stylegan2/lsd-01.py", line 7, in <module>
    L.hallucinate(file_name = 'song.mp4')
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/lucidsonicdreams/main.py", line 680, in hallucinate
    self.generate_frames()
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/lucidsonicdreams/main.py", line 528, in generate_frames
    .synthesis.run(w_batch, **Gs_syn_kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/stylegan2/dnnlib/tflib/network.py", line 629, in run
    mb_out = tf.get_default_session().run(out_expr, dict(zip(in_expr, mb_in)))
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 956, in run
    run_metadata_ptr)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1180, in _run
    feed_dict_tensor, options, run_metadata)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run
    run_metadata)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC.
         [[node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose (defined at /home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose':
  File "stylegan2/lsd-01.py", line 7, in <module>
    L.hallucinate(file_name = 'song.mp4')
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/lucidsonicdreams/main.py", line 680, in hallucinate
    self.generate_frames()
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/lucidsonicdreams/main.py", line 528, in generate_frames
    .synthesis.run(w_batch, **Gs_syn_kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/stylegan2/dnnlib/tflib/network.py", line 604, in run
    out_gpu = net_gpu.get_output_for(*in_gpu, return_as_list=True, **dynamic_kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/stylegan2/dnnlib/tflib/network.py", line 369, in get_output_for
    out_expr = self._build_func(*final_inputs, **build_kwargs)
  File "<string>", line 556, in G_synthesis
  File "<string>", line 555, in grow
  File "<string>", line 549, in <lambda>
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
    orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
    original_result = fn()
  File "<string>", line 554, in <lambda>
  File "<string>", line 555, in grow
  File "<string>", line 549, in <lambda>
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
    orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
    original_result = fn()
  File "<string>", line 554, in <lambda>
  File "<string>", line 555, in grow
  File "<string>", line 549, in <lambda>
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
    orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
    original_result = fn()
  File "<string>", line 554, in <lambda>
  File "<string>", line 555, in grow
  File "<string>", line 549, in <lambda>
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
    orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
    original_result = fn()
  File "<string>", line 554, in <lambda>
  File "<string>", line 551, in grow
  File "<string>", line 520, in block
  File "<string>", line 191, in upscale2d_conv2d
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/nn_ops.py", line 2204, in conv2d_transpose
    name=name)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/nn_ops.py", line 2275, in conv2d_transpose_v2
    name=name)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 1407, in conv2d_backprop_input
    name=name)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper
    op_def=op_def)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op
    attrs, op_def, compute_device)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal
    op_def=op_def)
  File "/home/user/PycharmProjects/lucidsonicdreams/venv/lib64/python3.6/site-packages/tensorflow_core/python/framework/ops.py", line 1748, in __init__
    self._traceback = tf_stack.extract_stack()

Error with GPU device on hallucinate() on MacBook Pro

I get an exception on hallicinate()'s first frame with the following traceback

Hallucinating... 

  0%|                                                                                                     | 0/6356 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "/Users/{USER}/.pyenv/versions/3.7.8/lib/python3.7/site-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call
    return fn(*args)
  File "/Users/{USER}/.pyenv/versions/3.7.8/lib/python3.7/site-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn
    target_list, run_metadata)
  File "/Users/{USER}/.pyenv/versions/3.7.8/lib/python3.7/site-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Cannot assign a device for operation G_mapping_1/_Run/G_mapping/latents_in: {{node G_mapping_1/_Run/G_mapping/latents_in}} was explicitly assigned to /device:GPU:0 but available devices are [ /job:localhost/replica:0/task:0/device:CPU:0, /job:localhost/replica:0/task:0/device:XLA_CPU:0 ]. Make sure the device specification refers to a valid device. The requested device appears to be a GPU, but CUDA is not enabled.
         [[G_mapping_1/_Run/G_mapping/latents_in]]

Specs:
MacBook Pro 2019 - 10.15.7 - Radeon Pro 555X 4 GB - Intel UHD Graphics 630 1536 MB

Only the abstract photo style is working

i was only able to use the asbtract photo style every other style give me this error

Downloading my little pony weights (This may take a while)... Download complete Traceback (most recent call last): File "c:/Users/JF/Desktop/music/music.py", line 10, in <module> L.hallucinate(file_name = 'hills_pony.mp4') File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 636, in hallucinate self.stylegan_init() File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 126, in stylegan_init self.Gs = pickle.load(f)[2] File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 279, in __setstate__ assert state["version"] in [2, 3] AssertionError

OSError: cannot load library

Hello, I am very interested in this project after watching your sample video. But when I tried to ">>> from lucidsonicdreams import LucidSonicDream" , I encountered the problem of "OSError: sndfile library not found". I can't solve it, hope you can help me. I'm very much obliged to you

Traceback (most recent call last):
File "D:\python\lib\site-packages\soundfile-0.10.3.post1-py3.6.egg\soundfile.py", line 142, in
raise OSError('sndfile library not found')
OSError: sndfile library not found

During handling of the above exception, another exception occurred:
OSError: cannot load library 'D:\python\lib\site-packages\soundfile-0.10.3.post1-py3.6.egg_soundfile_data\libsndfile64bit.dll': error 0x7e

RuntimeError: imageio.ffmpeg.download() has been deprecated. Use 'pip install imageio-ffmpeg' instead.'

Code's not running anymore :( Was one of my favourite notebooks, please let me know if and how it can be fixed!

OSError: [WinError 126] The specified module could not be found

I downgraded my python version to 3.7 in order to run this specific module, ran 'python3 -m pip install lucidsonicdreams', and saw the following output (shown for verification):

Then, when I run the sample code shown, I receive the following error:

File "c:/Users/Sean/Desktop/Music/lucid-sonic-dreams/Mytest.py", line 1, in
from lucidsonicdreams import LucidSonicDream
File "C:\Users\Sean\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\LocalCache\local-packages\Python37\site-packages\lucidsonicdreams_init_.py", line 1, in

from .main import *
File "C:\Users\Sean\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\LocalCache\local-packages\Python37\site-packages\lucidsonicdreams\main.py", line 9, in
from scipy.stats import truncnorm
File "C:\Users\Sean\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\LocalCache\local-packages\Python37\site-packages\scipy_init_.py", line 136, in
from . import distributor_init
File "C:\Users\Sean\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\LocalCache\local-packages\Python37\site-packages\scipy_distributor_init.py", line 61, in
WinDLL(os.path.abspath(filename))
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.7_3.7.2544.0_x64__qbz5n2kfra8p0\lib\ctypes_init.py", line 364, in init
self._handle = _dlopen(self._name, mode)
OSError: [WinError 126] The specified module could not be found

(shown for verification)

I have attempted uninstalling & reinstalling this module, and my version of Python. I have even looked into potential pitfalls where the backslashes could be cancelling out, potentially throwing an escape sequence error.

I have had no luck solving this. Please let me know if I can provide more information that would be of use.
Thanks.

Invalid argument: Conv2DCustomBackpropInputOp only supports NHWC

I'm getting this error when trying to run the script on an MP3 file:

 0% | 0/9612 [00:00<?, ?it/s]2021-03-14 12:44:22.497498: E tensorflow/core/common_runtime/executor.cc:642] Executor failed to create kernel. Invalid argument: Conv2DCustomBackpropInputOp only supports NHWC.
         [[{{node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose}}]]

My script is literally the one on the readme, any clues?

missing source code

It appears the function referenced in this line is not defined anywhere. Am I missing something?

TensorFlow pickle version too low

E:\aimv2\venv\Scripts\python.exe E:/aimv2/main.py
Preparing style...
Loading networks from abstract_photo.pkl...
Traceback (most recent call last):
File "E:\aimv2\main.py", line 7, in
L.hallucinate(file_name = 'E:\FFOutput\qby90.mp4')
File "E:\aimv2\lucidsonicdreams\main.py", line 708, in hallucinate
self.stylegan_init()
File "E:\aimv2\lucidsonicdreams\main.py", line 179, in stylegan_init
self.Gs = self.legacy.load_network_pkl(f)['G_ema'].to(device) # type: ignore
File "E:\aimv2\stylegan2\legacy.py", line 26, in load_network_pkl
G = convert_tf_generator(tf_G)
File "E:\aimv2\stylegan2\legacy.py", line 111, in convert_tf_generator
raise ValueError('TensorFlow pickle version too low')
ValueError: TensorFlow pickle version too low

Why???

LSD on Replicate

Hi,

I added Lucid Sonic Dreams to Replicate.com

https://replicate.com/pollinations/lucid-sonic-dreams

And with StyleGAN XL
https://replicate.com/pollinations/lucid-sonic-dreams-xl

You can also run them locally with cog. Check out the linked Github repositories if interested

Are classes correctly labeled?

Hi,
I love your work.
So I found that in WikiArt Example Generation.ipynb /https://colab.research.google.com/github/Norod/my-colab-experiments/blob/master/WikiArt_Example_Generation_By_Peter_Baylies.ipynb we can find the possible indices of the classes. However, after testing several examples, I am not sure if the labels are correct, for example if I repeat 120 12-times, I would expect to see the style of 'M.C. Escher', but that is not the case.

Please add command line arguments :(

AssertionError

Ubuntu 20.04
I made a test.py put it in folder "lucidsonicdreams and execute it from there.
What i get is this:
`Lucid) xxxxx:~/lucid$ python test.py
WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:34: The name tf.Dimension is deprecated. Please use tf.compat.v1.Dimension instead.

WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:74: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:128: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.

Preparing style...
WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:97: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.

WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:109: The name tf.set_random_seed is deprecated. Please use tf.compat.v1.set_random_seed instead.

WARNING:tensorflow:From /home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/tfutil.py:132: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

Downloading painting faces weights (This may take a while)...
Downloading...
From: https://drive.google.com/uc?id=1H-MYFZqngF1R0whm4bc3fEoX7VvOWaDl
To: /home/hades/lucid/painting faces.pkl
382MB [00:29, 13.1MB/s]
Download complete
Traceback (most recent call last):
File "test.py", line 9, in
duration = 90)
File "/home/hades/lucid/lucidsonicdreams/main.py", line 636, in hallucinate
self.stylegan_init()
File "/home/hades/lucid/lucidsonicdreams/main.py", line 126, in stylegan_init
self.Gs = pickle.load(f)[2]
File "/home/hades/anaconda3/envs/Lucid/lib/python3.7/site-packages/dnnlib/tflib/network.py", line 279, in setstate
assert state["version"] in [2, 3]
AssertionError
`

Anyone know how to solve this ??

UPDATE !!!!
For me the solution was:
Putting my script test.py and the wav/mp3 in the stylegan2 folder ! Now everything runs smooth without any errors

Maybe this is helpful for you !

Project fails to install

Using the collab example this is the error when running:

pip install lucidsonicdreams

Collecting lucidsonicdreams
  Downloading lucidsonicdreams-0.4.tar.gz (11 kB)
  Preparing metadata (setup.py) ... done
INFO: pip is looking at multiple versions of lucidsonicdreams to determine which version is compatible with other requirements. This could take a while.
  Downloading lucidsonicdreams-0.3.tar.gz (11 kB)
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  Preparing metadata (setup.py) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Setting up PyTorch plugin "bias_act_plugin"... Failed! Setting up PyTorch plugin "upfirdn2d_plugin"... Failed!

Doing everything as usual, when it starts hallucinating, I get this error repeatedly while it still progresses but very slow. Anyone know what could be the issue?

ffmpeg is a requirement on some systems

I could not get the script to run on macOS 11 with an MP3 file until I installed ffmpeg.

It can be solved by running brew install ffmpeg, but maybe a warning on the readme would be nice.

No module named 'torch_utils'

Had this working but now getting this error in colab, any suggestions? i've tried installing different versions of pytorch.

Installation errors

Hi - I'm getting several errors when running pip install on python 3.6 or 3.7. This is running in a docker container on either

• python:3.6-slim-buster
• python:3.7-stretch
• python:3.6-stretch

pip install lucidsonicdreams

Collecting lucidsonicdreams
  Downloading lucidsonicdreams-0.4.tar.gz (11 kB)
  Downloading lucidsonicdreams-0.3.tar.gz (11 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-q39u62_m/lucidsonicdreams_bddf7121fc1345a79d2bef3fe71038ba/setup.py'"'"'; __file__='"'"'/tmp/pip-install-q39u62_m/lucidsonicdreams_bddf7121fc1345a79d2bef3fe71038ba/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-9maokkz4
         cwd: /tmp/pip-install-q39u62_m/lucidsonicdreams_bddf7121fc1345a79d2bef3fe71038ba/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-q39u62_m/lucidsonicdreams_bddf7121fc1345a79d2bef3fe71038ba/setup.py", line 5, in <module>
        with open('requires.txt') as f:
    FileNotFoundError: [Errno 2] No such file or directory: 'requires.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/d7/83/4a4d53f2fb26fdb1c99cb7f6bbcda0a09803961674a3704181d85d3332df/lucidsonicdreams-0.3.tar.gz#sha256=305452861e1fa9abc5233022d45b0793f0c5ac78ef1cd0a070c87ad7b90ac8d4 (from https://pypi.org/simple/lucidsonicdreams/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Downloading lucidsonicdreams-0.2.tar.gz (11 kB)
    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-q39u62_m/lucidsonicdreams_875d03b894b34161a37add828ed8608c/setup.py'"'"'; __file__='"'"'/tmp/pip-install-q39u62_m/lucidsonicdreams_875d03b894b34161a37add828ed8608c/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-m2iwh0_d
         cwd: /tmp/pip-install-q39u62_m/lucidsonicdreams_875d03b894b34161a37add828ed8608c/
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-q39u62_m/lucidsonicdreams_875d03b894b34161a37add828ed8608c/setup.py", line 5, in <module>
        with open('requirements.txt') as f:
    FileNotFoundError: [Errno 2] No such file or directory: 'requirements.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/da/11/7023ff17dbe1c22a44e68d21733aba09377dc523420724d4fa1a2decc4c0/lucidsonicdreams-0.2.tar.gz#sha256=90c96ad446c4d12579737ba2b39476537dfbe42be8515e90294562191150e42e (from https://pypi.org/simple/lucidsonicdreams/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement tensorflow==1.15 (from lucidsonicdreams)
ERROR: No matching distribution found for tensorflow==1.15

Raspberry pi support?

Is there plans to make a version for raspberry pi? I'm having trouble installing it on mine due to tensorflow 1.15

python setup.py egg_info did not run successfully

I had this in Lucid Sonic Dreams - Tutorial Notebook
can someone help?
! pip install lucidsonicdreams

Collecting lucidsonicdreams
  Downloading lucidsonicdreams-0.4.tar.gz (11 kB)
  Preparing metadata (setup.py) ... done
INFO: pip is looking at multiple versions of lucidsonicdreams to determine which version is compatible with other requirements. This could take a while.
  Downloading lucidsonicdreams-0.3.tar.gz (11 kB)
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  Preparing metadata (setup.py) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Assertion Error when running hallucinate()

When running hallucinate() i get the following error:

L.hallucinate('test.mp4', speed_fpm=24, motion_randomness=0.8, resolution=120)
Preparing style...
Setting up TensorFlow plugin "fused_bias_act.cu": Failed!
Preparing audio...
Loading effects...


Doing math...



Hallucinating... 

  0%|                                                                                                                                                                              | 0/5470 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/test/lsdvenv/lib/python3.7/site-packages/lucidsonicdreams/main.py", line 680, in hallucinate
    self.generate_frames()
  File "/Users/test/lsdvenv/lib/python3.7/site-packages/lucidsonicdreams/main.py", line 525, in generate_frames
    np.tile(class_batch, (batch_size, 1)))
  File "/Users/test/stylegan2/dnnlib/tflib/network.py", line 604, in run
    out_gpu = net_gpu.get_output_for(*in_gpu, return_as_list=True, **dynamic_kwargs)
  File "/Users/test/stylegan2/dnnlib/tflib/network.py", line 350, in get_output_for
    self._get_vars()  # ensure that all variables have been created
  File "/Users/test/stylegan2/dnnlib/tflib/network.py", line 297, in _get_vars
    self._vars = OrderedDict(self._get_own_vars())
  File "/Users/test/stylegan2/dnnlib/tflib/network.py", line 286, in _get_own_vars
    self._init_graph()
  File "/Users/test/stylegan2/dnnlib/tflib/network.py", line 126, in _init_graph
    assert self._input_templates is None
AssertionError
>>> 

I'm on Big Sur.

index out of bounds

Hi!
I am trying out the script in order to sync some images I have generated using VQGAN+CLIP to my audio.
Here's the code:

def load_imgs(noise_batch, class_batch):
    # just loads N images randomly
    return images

L = LucidSonicDream('audio_5.mp3',
                    style = load_imgs, 
                    input_shape = 592,
                    num_possible_classes = 1000)

L.hallucinate('video_sync.mp4',
              output_audio = 'audio_sync.mp3',
              speed_fpm = 3,
              classes = [13, 14, 22, 24, 301, 84, 99, 100, 134, 143, 393, 394],
              class_shuffle_seconds = 10, 
              class_shuffle_strength = 0.1,
              class_complexity = 0.5,
              class_smooth_seconds = 4,
              motion_react = 0.35,
              flash_strength = 1)
              #contrast_strength = 0.5)

The error appears just at the end of the process:

IndexError                                Traceback (most recent call last)
<ipython-input-15-aeedb41e1387> in <module>()
     15               class_smooth_seconds = 4,
     16               motion_react = 0.35,
---> 17               flash_strength = 1)
     18               #contrast_strength = 0.5)

2 frames
/usr/local/lib/python3.7/dist-packages/lucidsonicdreams/main.py in apply_effect(self, array, index)
    742     '''Apply effect to image (array)'''
    743 
--> 744     amplitude = self.spec[index]
    745     return self.func(array=array, strength = self.strength, amplitude=amplitude)

IndexError: index 207 is out of bounds for axis 0 with size 207

Any idea on how to avoid it?
Thanks in advance!

Fix for broken Deps possibly? Please advise! LSD colab is BROKEN! Thanks!

See - main...pollinations:lucid-sonic-dreams:main suggestion for pollinations to mod to self refer so their fixes they made can be used, otherwise its referring to the same broken changes that you have that are breaking the colabs for LSD.

[fuse bias errors mostly to do with incompatibilities in breaking changes to several depenancies and potential v2 v3 python issues with v1/v2 tensorflow.]

ITs fixable but we need to specify the old working dependencies from what i can see, not the new breaking ones. All this began after the default code attempted to integrate ADA from what i could see? Correct me if i am wrong thanks!

tensorflow 1.15 depends on functools32, which breaks on Python3

I'm using Poetry to create a project that uses lucicsonicdreams, but the install won't work because of the dependency of tensorflow 1.15 on functools32, which is a package for python 2.7:

• Installing functools32 (3.2.3-2): Failed

  EnvCommandError

  Command ['/Users/systemallica/lucid-dreams/.venv/bin/pip', 'install', '--no-deps', '/Users/systemallica/Library/Caches/pypoetry/artifacts/cc/71/34/615e333a8fc645394774e7918927a0da138fed2cb5123662e5b7268791/functools32-3.2.3-2.tar.gz'] errored with the following return code 1, and output: 
  Processing /Users/systemallica/Library/Caches/pypoetry/artifacts/cc/71/34/615e333a8fc645394774e7918927a0da138fed2cb5123662e5b7268791/functools32-3.2.3-2.tar.gz
      ERROR: Command errored out with exit status 1:
       command: /Users/systemallica/lucid-dreams/.venv/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/3q/zrkjzwbs4mb6t8qfncsnhsyw0000gn/T/pip-req-build-065gasm7/setup.py'"'"'; __file__='"'"'/private/var/folders/3q/zrkjzwbs4mb6t8qfncsnhsyw0000gn/T/pip-req-build-065gasm7/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /private/var/folders/3q/zrkjzwbs4mb6t8qfncsnhsyw0000gn/T/pip-pip-egg-info-gw6z2dx3
           cwd: /private/var/folders/3q/zrkjzwbs4mb6t8qfncsnhsyw0000gn/T/pip-req-build-065gasm7/
      Complete output (1 lines):
      This backport is for Python 2.7 only.
      ----------------------------------------
  WARNING: Discarding file:///Users/systemallica/Library/Caches/pypoetry/artifacts/cc/71/34/615e333a8fc645394774e7918927a0da138fed2cb5123662e5b7268791/functools32-3.2.3-2.tar.gz. Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Please consider upgrading to a newer tensorflow version.

Tensorflow error once Hallucinating

I finally shook out installation problems (tensorflow==1.15 can be onerous, and in main.py line 32 the package dnnlib couldn't be found, but I worked around it).
I ran your example 3-line script, first on my mp3 then on your "chemical_love.mp3". In both cases lucidsonicdreams blows up after 0% done hallucinating.

Output and stack trace, with my explicit home dir replaced by '~':

---

Preparing style...
Preparing audio...
Loading effects...

Doing math...

Hallucinating...

0%| | 0/3876 [00:00<?, ?it/s]2021-03-13 23:20:40.020396: E tensorflow/core/common_runtime/executor.cc:642] Executor failed to create kernel. Invalid argument: Conv2DCustomBackpropInputOp only supports NHWC.
[[{{node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose}}]]
0%| | 0/3876 [00:03<?, ?it/s]
Traceback (most recent call last):
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1365, in _do_call
return fn(*args)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1350, in _run_fn
target_list, run_metadata)
File "~/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC.
[[{{node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/PycharmProjects/lucid-sonic-dreams/audiofile_to_mp4.py", line 19, in
file_name = '/PycharmProjects/lucid-sonic-dreams/chemical_love.mp4')
File "/_VENVs/Py3.7/lib/python3.7/site-packages/lucidsonicdreams-0.4-py3.7.egg/lucidsonicdreams/main.py", line 680, in hallucinate
File "/_VENVs/Py3.7/lib/python3.7/site-packages/lucidsonicdreams-0.4-py3.7.egg/lucidsonicdreams/main.py", line 528, in generate_frames
File "/PycharmProjects/lucid-sonic-dreams/dnnlib/tflib/network.py", line 629, in run
mb_out = tf.get_default_session().run(out_expr, dict(zip(in_expr, mb_in)))
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 956, in run
run_metadata_ptr)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1180, in _run
feed_dict_tensor, options, run_metadata)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1359, in _do_run
run_metadata)
File "~/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/client/session.py", line 1384, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Conv2DCustomBackpropInputOp only supports NHWC.
[[node G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose (defined at ~/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'G_synthesis_1/_Run/G_synthesis/cond/cond/cond/cond/128x128/Conv0_up/conv2d_transpose':
File "/PycharmProjects/lucid-sonic-dreams/audiofile_to_mp4.py", line 19, in
file_name = '/PycharmProjects/lucid-sonic-dreams/chemical_love.mp4')
File "/_VENVs/Py3.7/lib/python3.7/site-packages/lucidsonicdreams-0.4-py3.7.egg/lucidsonicdreams/main.py", line 680, in hallucinate
self.generate_frames()
File "/_VENVs/Py3.7/lib/python3.7/site-packages/lucidsonicdreams-0.4-py3.7.egg/lucidsonicdreams/main.py", line 528, in generate_frames
.synthesis.run(w_batch, **Gs_syn_kwargs)
File "/PycharmProjects/lucid-sonic-dreams/dnnlib/tflib/network.py", line 604, in run
out_gpu = net_gpu.get_output_for(*in_gpu, return_as_list=True, **dynamic_kwargs)
File "/PycharmProjects/lucid-sonic-dreams/dnnlib/tflib/network.py", line 369, in get_output_for
out_expr = self._build_func(*final_inputs, **build_kwargs)
File "", line 556, in G_synthesis
File "", line 555, in grow
File "", line 549, in
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
original_result = fn()
File "", line 554, in
File "", line 555, in grow
File "", line 549, in
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
original_result = fn()
File "", line 554, in
File "", line 555, in grow
File "", line 549, in
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
original_result = fn()
File "", line 554, in
File "", line 555, in grow
File "", line 549, in
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1224, in cond
orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/control_flow_ops.py", line 1061, in BuildCondBranch
original_result = fn()
File "", line 554, in
File "", line 551, in grow
File "", line 520, in block
File "", line 191, in upscale2d_conv2d
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/nn_ops.py", line 2204, in conv2d_transpose
name=name)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/nn_ops.py", line 2275, in conv2d_transpose_v2
name=name)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/ops/gen_nn_ops.py", line 1407, in conv2d_backprop_input
name=name)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper
op_def=op_def)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/util/deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/framework/ops.py", line 3357, in create_op
attrs, op_def, compute_device)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal
op_def=op_def)
File "/_VENVs/Py3.7/lib/python3.7/site-packages/tensorflow-1.15.0-py3.7-macosx-10.9-x86_64.egg/tensorflow_core/python/framework/ops.py", line 1748, in init
self._traceback = tf_stack.extract_stack()

How can I set Multiple GPUs to run

Hi Hi
Thanks for your contribution and open the Source
I want to know how can I set Multiple GPUs to run
It seems have nothing about the gpus in the main.py

Setting up TensorFlow plugin "fused_bias_act.cu": Compiling... Failed!

I get this with some of the downloaded weights but not all of them (eg lsun cats is fine, obama gives me the above error). I am using anaconda, with nvcc installed via conda install cudatoolkit-dev. Anyone else seeing this and found a workaround?

Support for latent numpy import

Hi there!

I am just wondering if it is possible to define latents that will be used in generation. From what it seems they are generated randomly and they are different on each run. Which parts of the code should I modify to be able to always use the same latents?

Thanks a milion!

ModuleNotFoundError: No module named 'lucidsonicdreams'

Im trying to run a test and this is the way i have the python file typed. Any help would be appreciated

(command i input)= python proud.py (to run the python below)

from lucidsonicdreams import LucidSonicDream

L = LucidSonicDream(song = 'proud.mp3',
style = 'abstract photos')

L.hallucinate(file_name = 'proud.mp4',
resolution = 360,
start = 30,
duration = 45)

files.download("proud of you.mp4")

Error im getting

Traceback (most recent call last):
File "proud.py" line 1 in
from lucidsonicdreams import LucidSonicDream
ModuleNotFoundError: No module named 'lucidsonicdreams

'

No such file or directory: 'requires.txt'

The Error "No such file or directory: 'requires.txt'" appears when I try to install the package, and I cannot manage to fix it.

Tutorial Notebook tensorflow error

Trying to run https://colab.research.google.com/drive/1Y5i50xSFIuN3V4Md8TB30_GOAtts7RQD?usp=sharing as is

ShowStyle cell throws this error:

ModuleNotFoundError: No module named 'tensorflow.python.platform'

I suspect it has something to do with the tensorflow version Colab is attempting to install

pip installation failed - No such file or directory: 'requires.txt' / 'requirements.txt'

I can't install lucidsonicdreams package from pip. How can I fix this?

> python --version
Python 3.9.1
> pip --version
pip 21.0.1 from c:\users\snowinmars\appdata\local\programs\python\python39\lib\site-packages\pip (python 3.9)

> pip install lucidsonicdreams
Collecting lucidsonicdreams
  Using cached lucidsonicdreams-0.4.tar.gz (11 kB)
  Using cached lucidsonicdreams-0.3.tar.gz (11 kB)
    ERROR: Command errored out with exit status 1:
     command: 'c:\users\snowinmars\appdata\local\programs\python\python39\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\snowinmars\\AppData\\Local\\Temp\\pip-install-ar6zwq56\\lucidsonicdreams_8fb841c67fb348edbc51308b18dbeca2\\setup.py'"'"'; __file__='"'"'C:\\Users\\snowinmars\\AppData\\Local\\Temp\\pip-install-ar6zwq56\\lucidsonicdreams_8fb841c67fb348edbc51308b18dbeca2\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\snowinmars\AppData\Local\Temp\pip-pip-egg-info-kilt0z0t'
         cwd: C:\Users\snowinmars\AppData\Local\Temp\pip-install-ar6zwq56\lucidsonicdreams_8fb841c67fb348edbc51308b18dbeca2\
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "C:\Users\snowinmars\AppData\Local\Temp\pip-install-ar6zwq56\lucidsonicdreams_8fb841c67fb348edbc51308b18dbeca2\setup.py", line 5, in <module>
        with open('requires.txt') as f:
    FileNotFoundError: [Errno 2] No such file or directory: 'requires.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/d7/83/4a4d53f2fb26fdb1c99cb7f6bbcda0a09803961674a3704181d85d3332df/lucidsonicdreams-0.3.tar.gz#sha256=305452861e1fa9abc5233022d45b0793f0c5ac78ef1cd0a070c87ad7b90ac8d4 (from https://pypi.org/simple/lucidsonicdreams/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
  Using cached lucidsonicdreams-0.2.tar.gz (11 kB)
    ERROR: Command errored out with exit status 1:
     command: 'c:\users\snowinmars\appdata\local\programs\python\python39\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\snowinmars\\AppData\\Local\\Temp\\pip-install-ar6zwq56\\lucidsonicdreams_1c85822b96914a29ad39ce142eb5599d\\setup.py'"'"'; __file__='"'"'C:\\Users\\snowinmars\\AppData\\Local\\Temp\\pip-install-ar6zwq56\\lucidsonicdreams_1c85822b96914a29ad39ce142eb5599d\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\snowinmars\AppData\Local\Temp\pip-pip-egg-info-tjkvyr4h'
         cwd: C:\Users\snowinmars\AppData\Local\Temp\pip-install-ar6zwq56\lucidsonicdreams_1c85822b96914a29ad39ce142eb5599d\
    Complete output (5 lines):
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "C:\Users\snowinmars\AppData\Local\Temp\pip-install-ar6zwq56\lucidsonicdreams_1c85822b96914a29ad39ce142eb5599d\setup.py", line 5, in <module>
        with open('requirements.txt') as f:
    FileNotFoundError: [Errno 2] No such file or directory: 'requirements.txt'
    ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/da/11/7023ff17dbe1c22a44e68d21733aba09377dc523420724d4fa1a2decc4c0/lucidsonicdreams-0.2.tar.gz#sha256=90c96ad446c4d12579737ba2b39476537dfbe42be8515e90294562191150e42e (from https://pypi.org/simple/lucidsonicdreams/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement tensorflow==1.15 (from lucidsonicdreams)
ERROR: No matching distribution found for tensorflow==1.15

No module named dnnlib.tflib

Hello can't get this working, have tried the dnnlib fix by pip installing the github libary but now im gettin no module named dnnlib.tflib

Any ideas?

Thanks a lot

Please add StyleGan3 support

The new version is available here:
https://github.com/NVlabs/stylegan3

Getting several install errors

ERROR: Command errored out with exit status 1:
command: 'C:\ProgramData\Anaconda3\envs\3-D-Art\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_4a0aa72bc164402da4ee92560c52efdb
\setup.py'"'"'; file='"'"'C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_4a0aa72b
c164402da4ee92560c52efdb\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'
"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\boo
ki\AppData\Local\Temp\pip-pip-egg-info-pjjiy2vy'
cwd: C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_4a0aa72bc164402da4ee92560c52efd
b
Complete output (5 lines):
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_4a0aa72bc164402da4ee92560c52efdb
setup.py", line 5, in
with open('requires.txt') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'requires.txt'
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/d7/83/4a4d53f2fb26fdb1c99cb7f6bbcda0a09803961674a3704181d
85d3332df/lucidsonicdreams-0.3.tar.gz#sha256=305452861e1fa9abc5233022d45b0793f0c5ac78ef1cd0a070c87ad7b90ac8d4 (from h
ttps://pypi.org/simple/lucidsonicdreams/). Command errored out with exit status 1: python setup.py egg_info Check the
logs for full command output.
Using cached lucidsonicdreams-0.2.tar.gz (11 kB)
ERROR: Command errored out with exit status 1:
command: 'C:\ProgramData\Anaconda3\envs\3-D-Art\python.exe' -c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_109d0e81245c40379f7f43e9aeed38c4
\setup.py'"'"'; file='"'"'C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_109d0e81
245c40379f7f43e9aeed38c4\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'
"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base 'C:\Users\boo
ki\AppData\Local\Temp\pip-pip-egg-info-11crgkgc'
cwd: C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_109d0e81245c40379f7f43e9aeed38c
4
Complete output (5 lines):
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\booki\AppData\Local\Temp\pip-install-lb5p0zlt\lucidsonicdreams_109d0e81245c40379f7f43e9aeed38c4
setup.py", line 5, in
with open('requirements.txt') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'requirements.txt'
----------------------------------------

Cannot assign a device for operation

Hi
Try to run simple code from example but get exception instantly after start 'Hallucinating...' process. Tensorflow can't find GPU?
Notebook with UHD Graphics 630 and GeForce RTX 2060
Cuda 11.3
Tensorflow 1.15.0
Windows 10

Console:

Hallucinating...

0%| | 0/2600 [00:00<?, ?it/s]
Traceback (most recent call last):
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1365, in _do_call
return fn(*args)
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1350, in _run_fn
target_list, run_metadata)
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1443, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Cannot assign a device for operation G_mapping_1/_Run/G_mapping/latents_in: {{node G_mapping_1/_Run/G_mapping/latents_in}} was explicitly assigned to /device:GPU:0 but available devices are [ /job:localhost/replica:0/task:0/device:CPU:0 ]. Make sure the device specification refers to a valid device.
[[G_mapping_1/_Run/G_mapping/latents_in]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "test1.py", line 6, in
L.hallucinate(file_name = 'C:\Proj\Self\NeuralNetworks\Ojo de Dios.mp4')
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 680, in hallucinate
self.generate_frames()
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 525, in generate_frames
np.tile(class_batch, (batch_size, 1)))
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 443, in run
mb_out = tf.get_default_session().run(out_expr, dict(zip(in_expr, mb_in)))
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 956, in run
run_metadata_ptr)
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1180, in _run
feed_dict_tensor, options, run_metadata)
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1359, in _do_run
run_metadata)
File "C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\client\session.py", line 1384, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Cannot assign a device for operation G_mapping_1/_Run/G_mapping/latents_in: node G_mapping_1/_Run/G_mapping/latents_in (defined at C:\Users\1\AppData\Local\Programs\Python\Python37\lib\site-packages\tensorflow_core\python\framework\ops.py:1748) was explicitly assigned to /device:GPU:0 but available devices are [ /job:localhost/replica:0/task:0/device:CPU:0 ]. Make sure the device specification refers to a valid device.
[[G_mapping_1/_Run/G_mapping/latents_in]]

Real time support

Hi,

First, thank you for your great work - it's incredible!

I was wondering if, in your opinion, it would be possible to extend your work to generate the visuals in real-time. This would mean using streaming of audio data (or, possibly, MIDI) rather than pre-rendered files. I guess the frame rate can be a little low at 1024, but it would be still great to have this option for someone who has a lot of GPUs. Do you think it would be anyhow realistic?

Keep up the amazing work!

need requirements versions

The package only specifies which libraries, but not which versions.. I'm having lots of dependencies incomptabilities...

Could it be posible having a "pip list" out which tells us the versions of the libraries which works alltogether?

Mixing 2 or more styles ?

I mostly use the tutorial notbok on colab. My question. Is it possible to use 2 or more different styles at the same time ?
Thank you in advance for the information !