vita-epfl / deposit Goto Github PK
View Code? Open in Web Editor NEW[ICRA 2023] Official implementation of "A generic diffusion-based approach for 3D human pose prediction in the wild".
License: GNU Affero General Public License v3.0
[ICRA 2023] Official implementation of "A generic diffusion-based approach for 3D human pose prediction in the wild".
License: GNU Affero General Public License v3.0
Hey, though the model training time is high, due to the computational complexity of denoising diffusion models, can the authors comment on the inference time of their approach? Does the model have high time complexity at inference or can it be implemented for real time inference?
Hey,
The approach mentioned in this paper seems very intriguing and useful. However, I wanted to test out the usage of just the pre-processing phase where the key points are repaired. Are there any particular steps that I can be pointed towards so that I am able to just observe the broken and repaired key points after observation is passed through the Pre-Process Diffusion block?
Hello, we are very interested in your work, and we would like to replicate your results.
On the Human3.6M dataset, we trained and evaluated the resulting model, achieving a prediction accuracy similar to that of the paper. However, on the AMASS dataset, the model we trained cannot reach the accuracy of the paper, and the gap is large. Our training parameters follow your code exactly. The final evaluation results are as follows:
Loss of training on AMASS datasets:
FDE on AMASS:
FDE on 3DPW:
We suspect it may be due to hyperparameter Settings or accidental problems. Can you provide training hyperparameters and chackpoint on AMASS and 3DPW datasets? It would be better if some suggestions could be made for our restoration work.
Hello
Thank you for providing your codes. But the dataset link seems broken. Is it possible for you to provide the dataset link?
Thank You
Hey authors,
I am very interested in your work. Could you please share your pre-trained checkpoints? I want to evaluate your model without training. In addition, your paper mentions that post-processing can enhance any posture prediction model. I wonder if it can be used in stochastic models. It seems that only determinative models are enhanced in this paper.
Hi authors,
Great work! The study mentions that post-processing can be used to enhance the human pose of any prediction model. Can the authors comment if it can be used for repairing key points. For example, if we have only 14 predicted key points in COCO format (from any model like MediaPipe/ YOLOv8), and 3 missing key points. Can the approach be used to predict the remaining key points? Thanks!
I appreciate the effort and the code-sharing very lot.
The training process takes a long time when using an Nvidia RTX 3090 to train the model (both small and large).
Each epoch can take up to 2 hours for the large model when the batch size is set to 16 (because of memory constraints).
Are you having the same problems or using more powerful setups?
Are there any ways, as far as you're aware, to reduce the training period?
Thank you for taking the time to respond.
Thank you for your grest work!
I saw that you used the cosine noise scheduler in the paper, could you tell me what its values are?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.