Comments (4)
It's a good idea, but currently the key idea of this paper is using kinematic knowedge in the architecture level so I haven't done more in the per frame inference. There is a paper called SPIN which can do an optimization per frame after the first step prediciton, you can follow it to get more inspirations. But I will keep working on this task so I believe it will be more stronger :)
from motionet.
Got you. I'll share numbers if/whenever I have them. Anyway bringing learned kinematics is a significant contribution! Great job
from motionet.
Hi @slava-smirnov ,
Very good question. In my experience, roughly there are three points:
- 2D detection: Our method uses 2d detection from Openpose as input, so giving a good 2d detection is the most important in this kind of setting. I will suggest the boundding box of detected person shouldn't be smaller than 256px so the 2d detection error will be in a acceptable range. And also, we can also smooth the 2d results or use better 2d detetor like [staf].(https://github.com/soulslicer/STAF/tree/staf), it must be helpful.
- Camera view: It also should be concerned. Our method is trained on Human3.6m dataset which includes 4 static cameras, which it's not enough for training a manner to estimate camera parameter. I will suggest to keep the camera always in front of the person like the videos which we select in our demostration.
- This method didn't require the specific format or parameter on video, any sequence which is longer than 101 frames(around 5s with 25 fps) can be feed into our pretrained network. In general, the fps will not be the problem, but if you capture something like 120 fps or higher, you need to downsample it to make the motion difference distribution be similar with training data.
from motionet.
hey! thnx for quick response. for 1 and 2 it’s quite clear. I was hoping for some inference time per frame on 3D component part (everything else other than 2D predictions)
from motionet.
Related Issues (20)
- kernel size HOT 2
- 如何将人体的关节信息映射到动画人物上的?
- 如何将人的关节信息映射到动画人物上? HOT 2
- With RGB image input for 3D motion prediction?
- Read the output of openpose on wild videos HOT 2
- 怎么改为输出zxy顺序的bvh文件? HOT 1
- How to obtain smooth animation? HOT 5
- Blender visualization issue. HOT 1
- 关于测试时如何获得更好的效果 HOT 1
- Several questions on the Neural FK. HOT 11
- BVH Output is upside down HOT 1
- How to use custom pose 2D key-points? HOT 12
- question about training pose in world space.
- about Global Root Positions Reconstruction Error.
- 每个关节点预测出来的rotation是关于哪里的rotation
- Project dependencies may have API risk issues
- How to convert h36m 3d pose to quaternions or euler angles?
- Calculate Joint Angles from 3D skeleton
- Training on custom dataset
- Global root position
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from motionet.