happy-jihye/cartoon-stylegan

Fine-tuning StyleGAN2 for Cartoon Face Generation

cartoon-stylegan's Issues

Feat. req. Win build / installer

subj

freezeFC and generator_source

Thanks for the work. Looks really cool! I have two questions about the script train.py:

(1) Does the parameter freezeFC mean that you want to freeze the whole style network (from z to w) on left of the generator? Looks you do not really freeze it but instead use the latent w computed from the source generator.

(2) For the generator_source, do we also need to load the weight of source generator before starting the training? I see you only define it without pre-loading any weight.

inference of cpu

is it possible to do inference on cpu in google colab?

Google Drive permissions [GOOGLE COLAB]

Permission denied: https://drive.google.com/uc?id=1yIn_gM3Fk3RrRphTPNBPgJ3c-PuzCjOB
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1OysFtj7QTy7rPnxV9TXeEgBfmtgr8575
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1Oylfl5j-XGoG_pFHtQwHd2G7yNSHx2Rm
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1wWt4dPC9TJfJ6cF3mwg7kQvpuVwPhSN7
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1yEky49SnkBqPhdWvSAwgK5Sbrc3ctz1y
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1z51gxECweWXqSYQxZJaHOJ4TtjUDGLxA
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1PJaNozfJYyQ1ChfZiU2RwJqGlOurgKl7
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1PILW-H4Q0W8S22TO4auln1Wgz8cyroH6
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1P5T6DL3Cl8T74HqYE0rCBQxcq15cipuw
Maybe you need to change permission over 'Anyone with the link'?
Permission denied: https://drive.google.com/uc?id=1P65UldIHd2QfBu88dYdo1SbGjcDaq1YL
Maybe you need to change permission over 'Anyone with the link'?

Please advise on how to convert PT model to ONNX.

Hello:
I found your repo., it looks great. However, I am rather new to Python language, but I have rather good experience with C#, and have some experience with ONNX models. I am using Python 3.9 on Windows 10.
I want to know if I can convert any of the PT model, like: 550000.PT to onnx model, like: 550000.onnx.
I have installed Netron 5.6.4, and I can view 550000.PT file, it looks very complicated.
Can you suggest on how to do this?
I found someone showed some Python script to convert other type of model to ONNX, but it seems they know the model very well. But I don’t know too much about any model used in your repo.
Please advise,
Thanks,

What is the code license?

ImportError: cannot import name 'ensure_checkpoint_exists' from 'utils'

Hi, Jihye !
Nice to meet you !

When I had tried to start all boxes in your collab I got this error.
Could you help me, please )

ImportError: cannot import name 'ensure_checkpoint_exists' from 'utils' (/content/Cartoon-StyleGan2/utils.py)

Code to inference new image

Thank you for sharing this good work. I'm testing new image on the Colab inference notebook you have shared but unfortunately the Example 3 gives me bad results on all of images I uploaded. Don't know why although I run the exact same code on Colab notebook. Can you please take a look and share code for inference new images. Thanks in advance. I think it's because of encoder model. This is the image after run the projector.py line of code on Colab notebook.

Maybe that leads to the generated images being distorted too.

How to rectify access denied due to multiple attempts?

Access denied with the following error:
Access denied with the following error:

Cannot retrieve the public link of the file. You may need to change
the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

 https://drive.google.com/uc?id=1yIn_gM3Fk3RrRphTPNBPgJ3c-PuzCjOB 


Too many users have viewed or downloaded this file recently. Please
try accessing the file again later. If the file you are trying to
access is particularly large or is shared with many people, it may
take up to 24 hours to be able to view or download the file. If you
still can't access a file after 24 hours, contact your domain
administrator. 

How to do layer swapping

How to blend 2 StyleGAN model

regarding training on a new dataset

Thanks for your amasing work shared here.
I was wondering how to train a model using my custom dataset.

1. is it a good way to adopt transfer learning on a novel dataset from one of models you provided, for example ffhq256.pt or Disney.pt?
2. should i freeze some layers (D or G) on the begining? or startup training without freeze layers, and do freezing after convergence?
3. traing with parameter augment is always better than without augment?
   looking forward to your replay, thank you ^_^

image test

How do you specify a picture for testing?

Can you show an example of encoding one photo and generating cartoon face of that photo?

Hi
instead of changing the facial expression in the colab, Can you show an example of encoding one photo and generating cartoon face of that photo?
Thank you

AttributeError: module 'clip' has no attribute 'tokenize'

Can you share used FreezeS/G/D values?

Hello and thanks for an awesome work!

May I know which layers were frozen (i. e. what are the values for the freezeS/G/D) in order to reproduce attached images? Also, am I correct to assume that 3 layers were used for the structure loss?

All the best,
Ivan

Colab notebook error because of compare_ssim

Thanks for providing this code!

When trying to run the following cell in the the Colaboratory notebook to project an input image to latent space :

#Project your own image and Make Eigenvector of latent spaces (by pretrained model)

!python projector.py --ckpt=/content/Cartoon-StyleGan2/networks/ffhq256.pt --factor='networks/factor' --e_ckpt=/content/Cartoon-StyleGan2/networks/encoder_ffhq.pt \
                            --files=/content/Cartoon-StyleGan2/celea.jpg 

I get the following error:

ImportError: cannot import name 'compare_ssim' from 'skimage.measure' (/usr/local/lib/python3.7/dist-packages/skimage/measure/init.py)

This seems to be because /usr/local/lib/python3.7/dist-packages/skimage/measure/__init__.py uses 'skimage.measure.compare_ssim' when it was recently changed to 'skimage.metrics.structural_similarity'

Link talking about skimage update: williamfzc/stagesepx#150

Example on feeding a source image as input and use the model to generate output

Currently we're using noise to generate source image and transfer it to output image right? How can we use our own custom source image?

about the freezing of generator

Thanks for the code~
I'm confused about freezing the specific layers of generator.

After you set the layers of the generator to false in Line 181
requires_grad(generator, False)

What's the purpose of Line 192~195?