vita-epfl/deposit

[ICRA 2023] Official implementation of "A generic diffusion-based approach for 3D human pose prediction in the wild".

deposit's Issues

Separation of Pre-Procession Diffusion block from the model

Hey,

The approach mentioned in this paper seems very intriguing and useful. However, I wanted to test out the usage of just the pre-processing phase where the key points are repaired. Are there any particular steps that I can be pointed towards so that I am able to just observe the broken and repaired key points after observation is passed through the Pre-Process Diffusion block?

The value of cosine noise scheduler

Thank you for your grest work!
I saw that you used the cosine noise scheduler in the paper, could you tell me what its values are?

Regarding Usability as 3D Human Pose Keypoint Repair Pipeline

Hi authors,
Great work! The study mentions that post-processing can be used to enhance the human pose of any prediction model. Can the authors comment if it can be used for repairing key points. For example, if we have only 14 predicted key points in COCO format (from any model like MediaPipe/ YOLOv8), and 3 missing key points. Can the approach be used to predict the remaining key points? Thanks!

Request checkpoints

Hey authors,
I am very interested in your work. Could you please share your pre-trained checkpoints? I want to evaluate your model without training. In addition, your paper mentions that post-processing can enhance any posture prediction model. I wonder if it can be used in stochastic models. It seems that only determinative models are enhanced in this paper.

Regarding Inference Time required by the Model

Hey, though the model training time is high, due to the computational complexity of denoising diffusion models, can the authors comment on the inference time of their approach? Does the model have high time complexity at inference or can it be implemented for real time inference?

Dataset link broken

Hello

Thank you for providing your codes. But the dataset link seems broken. Is it possible for you to provide the dataset link?

Thank You

Training Time

I appreciate the effort and the code-sharing very lot.
The training process takes a long time when using an Nvidia RTX 3090 to train the model (both small and large).
Each epoch can take up to 2 hours for the large model when the batch size is set to 16 (because of memory constraints).
Are you having the same problems or using more powerful setups?
Are there any ways, as far as you're aware, to reduce the training period?
Thank you for taking the time to respond.