About Inference speed

[vitae-transformer]

About Inference speed

[Annbless]

Thanks for your attention. Please refer to the paper for the settings in the speed test. With the advanced GPUs and PyTorch framework, ViTPose is faster than HRNet. Besides, the inference speed using tensorRT is not only related to the model but also the configurations. e.g., the maximum memory allowed or the optimal searched calculation manner.

[gpastal24]

Hi, thank you for answering.
I had run a test in native Pytorch as well. ViTPose was indeed faster or similar when the batch size was equal to 1.
I tested the yolov5 hrnet and vitpose pipeline with the webcam for single person infrerence and the VitPose method had indeed higher fps.
When i increased the batch size to 10 ,HRNet for some reason was 2-3 times faster both in the inference test and with a video. If I understood correctly these results could be related to my GPU (GTX 1650)?
In the following pictures I have attached the inference tests in Pytorch. The first row in each picture is with batch 1 while the second with batch size equal to 10.