idea-research/dreamwaltz

[NeurIPS 2023] Official implementation of the paper "DreamWaltz: Make a Scene with Complex 3D Animatable Avatars".

dreamwaltz's Issues

Where do I get the pretrained ControlNet?

Thanks for your great work! I met a problem when I want to download the pretrained model. I can not find the below models on the Hugging Face.

MODEL_CARDS = {
    'pose': "fusing/stable-diffusion-v1-5-controlnet-openpose",
    'depth': "fusing/stable-diffusion-v1-5-controlnet-depth",
    'canny': "fusing/stable-diffusion-v1-5-controlnet-canny",
    'seg': "fusing/stable-diffusion-v1-5-controlnet-seg",
    'normal': "fusing/stable-diffusion-v1-5-controlnet-normal",
}

When will the code be released?

Thanks for your great job, I would like to know When will the code be released?

how to get 512 resolution results and how to extract mesh Thanks

nice job!
1.how to get 512 resolution results
2.how to extract mesh
Thanks

Supporting multiple GPU running?

Amazing work! Is this network Supports multi-GPU computing？

Program stuck

When I was running DreamWaltz, the program got stuck. After debugging, I found that the code was stuck in the red box. Do you know what the reason is?

Training Time

How many gpu hours are needed to train your model on a single NVIDIA 3090?