Comments (10)
@molo32
That's really a good suggestion !
But we are just too busy to update this for now. Colab might be added after CVPR submission.
from frankmocap.
@molo32 I was able to make it work with the following commands in a Google Colab instance:
!git clone https://github.com/facebookresearch/frankmocap.git
cd /content/frankmocap/
pip install -r docs/requirements.txt
pip install detectron2 -f https://dl.fbaipublicfiles.com/detectron2/wheels/cu101/torch1.6/index.html
pip install pytorch3d
!sh scripts/install_frankmocap.sh
Download SMPL Model (Neutral model: basicModel_neutral_lbs_10_207_0_v1.0.0.pkl): https://github.com/facebookresearch/frankmocap/blob/master/docs/INSTALL.md
Download SMPLX Model (Neutral model: SMPLX_NEUTRAL.pkl):
https://github.com/facebookresearch/frankmocap/blob/master/docs/INSTALL.md
!apt-get install -y xvfb x11-utils
!xvfb-run -a python -m demo.demo_frankmocap --input_path ./sample_data/han_short.mp4 --out_dir ./mocap_output
I got a segmentation fault at the end (ffmpeg), but the video seems rendered in the output folder.
from frankmocap.
@molo32 I was able to make it work with the following commands in a Google Colab instance:
!git clone https://github.com/facebookresearch/frankmocap.git cd /content/frankmocap/ pip install -r docs/requirements.txt pip install detectron2 -f https://dl.fbaipublicfiles.com/detectron2/wheels/cu101/torch1.6/index.html pip install pytorch3d !sh scripts/install_frankmocap.sh
Download SMPL Model (Neutral model: basicModel_neutral_lbs_10_207_0_v1.0.0.pkl): https://github.com/facebookresearch/frankmocap/blob/master/docs/INSTALL.md
Download SMPLX Model (Neutral model: SMPLX_NEUTRAL.pkl):
https://github.com/facebookresearch/frankmocap/blob/master/docs/INSTALL.md!apt-get install -y xvfb x11-utils !xvfb-run -a python -m demo.demo_frankmocap --input_path ./sample_data/han_short.mp4 --out_dir ./mocap_output
I got a segmentation fault at the end (ffmpeg), but the video seems rendered in the output folder.
can you share the notebook?
from frankmocap.
I made a notebook aswell
from frankmocap.
Hey guys, it worked like a charm here, too, with four considerations, as already said above.
- In my case, I removed the opendr from the requirements.txt and installed it via the GitHub repository.
- Set the GPU;
- Sign up and download SMPL and SMPLX models (put it in the drive or someplace easy to access in the colab;
- The segmentation fault of FFmpeg will occur in the and, just ignore it.
The notebook is still raw and poorly documented, but if you guys want to take a look: https://colab.research.google.com/drive/1RaS5NKP2RsrbKuAy2ugCQDj-U_Qn1tXR?usp=sharing
Should work near out-of-the-box, respecting the four observations. OBS: once again, congratulations to the Frank-mocap team for the great work.
from frankmocap.
I have executed the readme indications step by step with success (notebook)
I hope this can help.
from frankmocap.
@Tikquuss
Thanks ! That's really helpful !
from frankmocap.
Hey guys, it worked like a charm here, too, with four considerations, as already said above.
- In my case, I removed the opendr from the requirements.txt and installed it via the GitHub repository.
- Set the GPU;
- Sign up and download SMPL and SMPLX models (put it in the drive or someplace easy to access in the colab;
- The segmentation fault of FFmpeg will occur in the and, just ignore it.
The notebook is still raw and poorly documented, but if you guys want to take a look: https://colab.research.google.com/drive/1RaS5NKP2RsrbKuAy2ugCQDj-U_Qn1tXR?usp=sharing
Should work near out-of-the-box, respecting the four observations. OBS: once again, congratulations to the Frank-mocap team for the great work.
@LucaswasTaken - I've executed all the code cells -- thanks for sharing them -- but I'm getting "No module named demo.demo_bodymocap" from Python when I try to run tests. Is this from missing environment info that the install doc said to create via "conda create -n venv_frankmocap python=3.7; conda activate venv_frankmocap" right at the start?
from frankmocap.
@LucaswasTaken - I've executed all the code cells -- thanks for sharing them -- but I'm getting "No module named demo.demo_bodymocap" from Python when I try to run tests. Is this from missing environment info that the install doc said to create via "conda create -n venv_frankmocap python=3.7; conda activate venv_frankmocap" right at the start?
Have you found a solution to the problem?
from frankmocap.
Hey guys, it worked like a charm here, too, with four considerations, as already said above.
- In my case, I removed the opendr from the requirements.txt and installed it via the GitHub repository.
- Set the GPU;
- Sign up and download SMPL and SMPLX models (put it in the drive or someplace easy to access in the colab;
- The segmentation fault of FFmpeg will occur in the and, just ignore it.
The notebook is still raw and poorly documented, but if you guys want to take a look: https://colab.research.google.com/drive/1RaS5NKP2RsrbKuAy2ugCQDj-U_Qn1tXR?usp=sharing
Should work near out-of-the-box, respecting the four observations. OBS: once again, congratulations to the Frank-mocap team for the great work.@LucaswasTaken - I've executed all the code cells -- thanks for sharing them -- but I'm getting "No module named demo.demo_bodymocap" from Python when I try to run tests. Is this from missing environment info that the install doc said to create via "conda create -n venv_frankmocap python=3.7; conda activate venv_frankmocap" right at the start?
I have found a solution
you have to turn on the GPU from the beginning of the code,
So turn on the GPU
and execute all the commands again
from frankmocap.
Related Issues (20)
- Undefined symbol: _ZN6caffe28TypeMeta21_typeMetaDataInstanceIN3c107complexIfEEEEPKNS_6detail12TypeMetaDataEv HOT 2
- what's the difference of ego_centric and third_view hand detector? HOT 1
- sh install hand_detectors.sh when I run this command (in install_frankmocap.sh) I was always met with compiling warning
- How to use "pred_body_pose" data? HOT 6
- Is the axis of joint angle like below? HOT 2
- OpenGL.error.NullFunctionError: Attempt to call an undefined function glutInit, check for bool(glutInit) before calling HOT 1
- ques about the cam parameter converge HOT 5
- Can the parameters of hand be used to output mano? HOT 1
- hand_pose is global or relatation HOT 1
- Using multcamera for hand tracking calibration HOT 1
- Some question about the initial pose of body and hand HOT 1
- how to replace light-openpose with mediapipe for human pose detection HOT 2
- Questions about 3d joint and 2d joint HOT 1
- Implementing the algorithm (training) HOT 1
- About the pose of hand HOT 3
- How to dealing with wrong hand pose? HOT 5
- Reconstruction of the hand HOT 3
- The speed of handtracking. HOT 1
- Problem in hand detection module... HOT 3
- RuntimeError: Not compiled with GPU support HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from frankmocap.