Comments (4)
Besides, I calculate the mean(0.0327) and std(0.9966) of learnable_vector
and it's more like a random Gussian sampling so I'm doubting whether its value changed or not during training.
from paint-by-example.
We appreciate your interest in our work. I apologize for accidentally writing this bug during the code cleanup. This bug has now been fixed.
Regarding the learnable vector resembling Gaussian noise, I believe it is caused by the two factors listed below. 1) It is initialized by a Gaussian distribution. 2) Because the learning rate is small, it does not deviate too far from the initial value.
We have also retrained the network and tracked the value and gradient of the learnable vector during the training process. As a result, the gradient of the learnable vector is quite small.
from paint-by-example.
Thansks!
from paint-by-example.
I also have the same question about the changes in the parameters of to_k, to_q in cross-attention module,I tried iterating the network many times, but there is no change in the parameters of these two parts. The guess is caused by that only one-dimensional class vectors are selected as cond. https://github.com/Fantasy-Studio/Paint-by-Example/issues/
Have you retrained the code and have you encountered the same problem?
Looking forward to hearing from you!
from paint-by-example.
Related Issues (20)
- Finetune Paint by example model. HOT 2
- Evaluation metrics
- Minimum GPU VRAM for training HOT 1
- training problem “pop from empty list”
- model saving checkpoints problem HOT 1
- Generate effect issues when mask size is different HOT 3
- huggingface space demo not working anymore HOT 1
- Paint by example support use segment image as reference image ? HOT 1
- 使用矩形(长宽不等)图片推理过程报错
- Washed out images HOT 1
- Issue when running sh test.sh HOT 1
- Training from scratch
- Web demo is not working HOT 1
- finetuning model HOT 3
- Problem about cross-attention during training HOT 1
- Question about reference image
- Input image and mask image size ? HOT 2
- Why the scale is setting to in inference process?
- Randomly deactivated condition during training?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paint-by-example.