question about hand joints

[facebookresearch]

question about hand joints

[penincillin]

@ahsan3803
The order of hand joints are different depends on whether is obtained from hand-only module and whole body module (hand plus body).
If it is predicted from hand-only module, then the order of joints should be:

where 00 is the joints closest to wrist and 03 is the finger tips.

If the hand joints is obtained from whole-body module, the it should be this order for joints, which is just the link you shared.

[ahsan3803]

@lisa676 I think it is trivial to get 3D hand joints from SMPLX, check get_smplx_output and get_pred_result to get predicted 3D joints. Hope so it will work.

[penincillin]

@lisa676
Under which scenario you want to obtain hand joints ? Is the hand alone scenario or hand plus body ?

[lisa676]

@penincillin Hand alone scenario
@ahsan3803 Thanks for possible solution, I did try but unable to get, could you elaborate more about it.

[ahsan3803]

@lisa676 I was able to get 21 3D joints for each hand as author stated in this comment. But when I try to draw these 3D joints then I can't get right skeleton of hand, there is little problem. @penincillin can you confirm that we need to use 3D joints from here or I'm going in wrong way?

[penincillin]

@lisa676
Please check the updated code for predicted 3D hand joints.
predicted hand joints in original SMPL space
predicted hand joints in image space

[penincillin]

@ahsan3803
Please refer to the comment below.

[ahsan3803]

@penincillin I already got 3D joints in same way as you did. But in drawing 3D skeleton there is something wrong, may be problem is in my drawing code. I'm trying to solve it.

[penincillin]

@ahsan3803
How do you draw 3D joints ? In 3D space or 2D space ?
Besides, to draw skeleton, you need to know the order of joints ? Which order are you using ?

[ahsan3803]

@penincillin I'm trying to draw these joints in 3D space. I'm using this order for joints. Seems that 3D results from SMPLX is ok but there is problem in skeleton joints. Can you confirm the order of joints that this order is ok or need to change something?

[ahsan3803]

@penincillin thanks for clarification, I was following wrong order. I will use this order to draw 3D skeleton.

[lisa676]

@ahsan3803 did you draw these points successfully?

[penincillin]

@lisa676
Would you mind share your problems here ? Maybe I can help you :)

[lisa676]

@penincillin Thanks Rong for your kind help. I have solved my problem. This is great repository I have ever seen. Keep it up 👍

[lisa676]

@penincillin Hi dear Rong. Today I just read your new amazing work Chasing the Tail in Monocular 3D Human Reconstruction with Prototype Memory, it's really wonderful idea and work. Is there any plan to share code for this new work on Github?