Comments (3)
Hi, I don't quite get what you mean by re-using the generated data to put in it's original place.
Is it like [crop the head -> model inference -> put back to original image]?
or like warp the previous generated frame using optical flow?
from animegan2-pytorch.
Hey sorry for the confusion,
So If I understand correctly the script detects the face, stabilize and than process it. And the reseult is like in this video.
https://youtu.be/fZ3AqJwcPhU
When I want to replace the real face ( in the target video) with the toonified one, the toonified one is jumpy (becouse of the face detect and stabilization)
I was wondering if it is possible to use the stabilization data that the script generated by head tracking in the first place, reverse it and apply to the final image? So it will have the original movement and size and it will follow the head as it was in the original video.
Hope this makes sense :)
from animegan2-pytorch.
Actually you don't need to crop & align the head. Instead, you can simply resize the image:
- get a video frame
- run face detector on the video frame
- compute the face size x
- resize the video frame so that the resulting face size becomes about 400px (which means the resize ratio = 400 / x)
- apply model to the resized image, and resize the output image back to its original size
- go back to 1 and process next frame
from animegan2-pytorch.
Related Issues (20)
- the generated pictures are some vague
- illegal hardware instruction (core dumped) HOT 1
- PNG images with transparent background are not supported HOT 5
- How to Convert Full Body Photo HOT 6
- How to train face model?
- Is there a way to adjust weights and make it more cartoony?
- Can face_paint_512_v2 be converted to torch mobile? HOT 1
- ml2
- data size
- Some pictures are ‘dirty’ when apply to full body photo, is there a way to improve it?
- output face with anime outline HOT 1
- Why the pytorch model uses significantly more gpu memory than onnx and TensorFlow
- Can celeba_distill be converted to torch mobile ?
- Eyebrows are recognized as eyes.How to correct it? HOT 1
- Missing file or folder : wine
- AnimeGAN with Playtorch
- Why is the AnimeGANv2 result different from yours?
- face_paint_512_v1/v2 对照片人全身或者三分之二全身时候,面部微笑的表情不太好。
- convert pytorch model failed by using convert_ weights.py
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from animegan2-pytorch.