Comments (4)
I was able to run the base model, python demo/top_down_video_demo_with_mmdet.py demo/mmdetection_cfg/yolov3_d53_320_273e_coco.py https://download.openmmlab.com/mmdetection/v2.0/yolo/yolov3_d53_320_273e_coco/yolov3_d53_320_273e_coco-421362b6.pth configs/body/2d_kpt_sview_rgb_img/topdown_heatmap/coco/ViTPose_base_coco_256x192.py checkpoint/vitpose-b.pth --video-path /workplace/efsdrive/users/sgattupa/pose/datasets/video.mp4 --out-video-root vis_results_vit_b
. I did not try vit-huge model. My pytorch version is 1.9.0+cu102. Installed mmdet and mmcv-full same as you did. Only difference is peerhaps I installed Vitpose after I installed mmpose and mmdet.
from vitpose.
However, I tried this and this is working properly. But not with ViT.
python demo/top_down_video_demo_with_mmdet.py \
demo/mmdetection_cfg/yolov3_d53_320_273e_coco.py \
https://download.openmmlab.com/mmdetection/v2.0/yolo/yolov3_d53_320_273e_coco/yolov3_d53_320_273e_coco-421362b6.pth \
configs/body/2d_kpt_sview_rgb_img/topdown_heatmap/coco/hrnet_w48_coco_256x192.py \
https://download.openmmlab.com/mmpose/top_down/hrnet/hrnet_w48_coco_256x192-b9e0b3ab_20200708.pth \
--video-path ../UCF_Videos/Fighting/Fighting018_x264.mp4 \
--out-video-root ../output/test1
from vitpose.
Thanks @gsrujana !!
I managed to make it work with the following steps.
conda create -n open-mmlab python=3.8.5 -y
conda activate open-mmlab
conda install pytorch=1.10.0 torchvision cudatoolkit=10.2 -c pytorch
pip install -U openmim
mim install mmcv-full==1.5.0
pip install mmdet
git clone https://github.com/ViTAE-Transformer/ViTPose.git
cd ViTPose
pip install -v -e .
pip install timm==0.4.9 einops
Some tips for others:
I checked this page to find the compatible CUDA and PyTorch versions:
https://mmcv.readthedocs.io/en/latest/get_started/installation.html
Also, this page to find the compatible mmcv version to be installed using MIM (change the CUDA version and Torch version in the URL accordingly):
https://download.openmmlab.com/mmcv/dist/cu102/torch1.10.0/index.html
Looks like the order of installing : mmcv, mmdet and then ViTPose needs to be maintained.
from vitpose.
Thanks @gsrujana !!
I managed to make it work with the following steps.
conda create -n open-mmlab python=3.8.5 -y conda activate open-mmlab conda install pytorch=1.10.0 torchvision cudatoolkit=10.2 -c pytorch pip install -U openmim mim install mmcv-full==1.5.0 pip install mmdet git clone https://github.com/ViTAE-Transformer/ViTPose.git cd ViTPose pip install -v -e . pip install timm==0.4.9 einops
Some tips for others:
I checked this page to find the compatible CUDA and PyTorch versions: https://mmcv.readthedocs.io/en/latest/get_started/installation.html
Also, this page to find the compatible mmcv version to be installed using MIM (change the CUDA version and Torch version in the URL accordingly): https://download.openmmlab.com/mmcv/dist/cu102/torch1.10.0/index.html
Looks like the order of installing : mmcv, mmdet and then ViTPose needs to be maintained.
Hey, when I use the script as is, I get the following error:
Traceback (most recent call last):
File "top_down_video_demo_with_mmdet.py", line 165, in <module>
main()
File "top_down_video_demo_with_mmdet.py", line 125, in main
pose_results, returned_outputs = inference_top_down_pose_model(
File "/home/nshah/work/packages/vitpose/mmpose/apis/inference.py", line 415, in inference_top_down_pose_model
poses, heatmap = _inference_single_pose_model(
File "/home/nshah/work/packages/vitpose/mmpose/apis/inference.py", line 307, in _inference_single_pose_model
return result['preds'], result['output_heatmap']
KeyError: 'preds'
The output of the model only contains a heatmap and not the actual keypoints. Did you modify the script to get the keypoints?
from vitpose.
Related Issues (20)
- APT-36k train valid(test) split
- Support for Selective Person Tracking in Multi-Person Videos
- which config file can train COCO+AIC+MPII dataset?
- Questions about table5 in the paper
- Issue about the padding when building the PatchEmbedding layer HOT 1
- the config about ViTPose small_simple
- where is smpl_mean_params.npz
- Question about parameter "max_num_joints" HOT 1
- Inconsistency in Reported Experimental Results for ViTPose and ViTPose++ Across Papers HOT 2
- Assertion Error During Testing HOT 1
- How to identify occluded hands?
- Duplicate code in topdown_heatmap_simple_head.py
- What is the details of public-data/ViTPose on huggingface? HOT 1
- about input size
- Output keypoints from Huggingface demo?
- the code for the visualization results of Figure 8 in the vitpose++ paper
- what is backbone.cls_token weights, where it is used?
- Loss is zero while training ViTPose Base with custom dataset
- how to run inference with pretrained model? HOT 1
- Breakpoint Resume Transmission
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vitpose.