Comments (2)
Hello,
Thank you for your interest!
You are correct, the reconstructed image will have these artifacts consisting of noisy edges where patches touch each other. To circumvent this, in a sort-of hacky manner, I have devised smoothing.py
which performs linear interpolation at the borders, making the image look clearer.
This is an open problem. A possible cause, in my opinion, is that, given an image patch, the network does not have any explicit information regarding the surrounding patches, therefore not knowing how to treat that particular pixels on the border.
I have started to brush-up the project, so far ensuring that training works with the latest PyTorch (1.7.0). I plan to devise some experiments in order to fix the patching issues, but feel free to contribute if you have an idea!
Keep an eye on #17 for further updates!
All the best,
Alex
from cae.
Thanks for explanation. I think the cause you described is correct, in other words, latent variables mainly affect their responsive pixels in the output but they have a wide receptive field, so neighbor patches latent variables affect the border pixels in current patch. Let me know if I'm wrong.
One possible way is to not dividing the image to patches and sweep the image with the conv network. I'm doing something similar to what you've done using 32x32 patches as training data and tried the method. The result showed a different kind of artifact which I believe is because the padding was a significant part of training data but in action there is not a lot of padding in a high resolution image. Because you trained your network on 128x128 patches you should not see this artifact a lot. What do you think about it?
Best regards,
Amin
from cae.
Related Issues (20)
- Model Architecture related question HOT 2
- Change structure to conform to PyTorch skel HOT 1
- How to caculate bpp HOT 1
- How Long does It Take to Train Your Model HOT 2
- Could you post a guide to use your model and code, please? HOT 2
- Refactoring
- Easy manip of latent representation
- How to control the degree of image distortion and bitstream size in your code HOT 2
- How I can get the compressed image only when save image ? , (not the original image and the compressed image) HOT 2
- Explicitly control latent size (& padding etc.)
- How can I obtain the image encoding? HOT 1
- Use encoder and decoder separately in different files HOT 2
- How do you measure compression quality? HOT 1
- In-depth evaluation and report
- Is the loss function correct? HOT 2
- Write proper documentation
- where is the training dataset? HOT 1
- Do you have a model that has already been trained? HOT 5
- About result HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cae.