Comments (6)
@sk1840939 how about transfering the depth points of all the joints into the real world coordinates then plot in color map?
from evoskeleton.
Does the 2d-to-3d lifting model actually predict a location for the hip/pelvis joint? OR, does the model predict all of the other 16 joints in relation to the hip joint?
It seems like when we run
UnNormalizeData
inexamples/inference.py
, the first joint location (which corresponds to the hip) is always[0,0,0]
because we are choosing to ignore that joint instats['dim_ignore_3d']
. Is there a way to avoid setting the hip to (0,0,0)?In my use case, I would like to avoid "fixing" or "pinning" a joint to the origin (or any other arbitrary point) for rendering purposes.
The prediction is 3D pose relative to the hip joint and does not include subject location. If you want to plot the trajectory in 3D, you may consider recording the root location in 3D. Then you can add the prediction back to the root location.
from evoskeleton.
Thank you for your reply!
If you want to plot the trajectory in 3D, you may consider recording the root location in 3D. Then you can add the prediction back to the root location.
Can you expand on "recording the root location in 3D"? Is this information that the model already captures in the output from the cascaded-lifter model? Or, is this information I am responsible for generating?
from evoskeleton.
Thank you for your reply!
If you want to plot the trajectory in 3D, you may consider recording the root location in 3D. Then you can add the prediction back to the root location.
Can you expand on "recording the root location in 3D"? Is this information that the model already captures in the output from the cascaded-lifter model? Or, is this information I am responsible for generating?
I guess it's the absolute real world coordinate of hip. So that you only need to add or minus relative depth of other 16points after the net inference.
from evoskeleton.
Thank you for your reply!
If you want to plot the trajectory in 3D, you may consider recording the root location in 3D. Then you can add the prediction back to the root location.
Can you expand on "recording the root location in 3D"? Is this information that the model already captures in the output from the cascaded-lifter model? Or, is this information I am responsible for generating?
This information is generated in this prepare_data_dict method: there is root location in the camera coordinate system
EvoSkeleton/libs/dataset/h36m/data_utils.py
Line 416 in b2b355f
You can keep these information and use them when you need to visualize the 3D trajectory.
from evoskeleton.
Thank you! That should solve my issue. Closing the issue, but I will reopen it if there are any related problems.
from evoskeleton.
Related Issues (20)
- Regarding the 2D HPE model HOT 2
- training input size and inference input size not match HOT 32
- camera params in cameras.npy HOT 2
- generating other poses from a known pose HOT 7
- ImportError: No module named libs.hhr.config HOT 3
- AttributeError: module 'libs.utils' has no attribute 'utils' HOT 5
- 2d poses from 3d pose HOT 11
- 2D to 3D with own data HOT 6
- weird 3D Pose
- Input of the plot_distribution in anglelimits.py HOT 4
- Inconsistency between pretrained HRNet 2D detector and twoDPose_HRN.npy HOT 7
- Data Preprocessing when test on 3dhp dataset HOT 3
- Obtain 3D skeleton with 2D key-points as inputs using SMPLify by own data HOT 3
- Source of 2D keypoints when eval on 3dhp dataset HOT 1
- Preprocessed npz file of HRNet HOT 1
- About 2D anchor of the cropped image HOT 3
- Regarding h36m image HOT 5
- 模型下载问题 HOT 1
- annotate_3D.py
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from evoskeleton.