Comments (8)
Hi, my client example works with wang-xinyu implementation of yolo-trt plugin (release v1.3.0 of this repo), doesn't work with current implementation on master branch(jkjung-avt implementation) , I should change input/output layer names
as you rightly wrote, but also pre and post processing part according to his code, I don't know when I'll have the time to do it
from yolov4-triton-tensorrt.
The current main branch has changes in preparation for a v1.4.0 release.
To use the c++ client check out the v1.3.0 release tag.
from yolov4-triton-tensorrt.
has the yolov4.wts file changed in the google drive? it fails to produce the .engine file using the v1.3 release
from yolov4-triton-tensorrt.
for c++ client try to use yolov4.wts weights from tensorrtx-modelzoo
from yolov4-triton-tensorrt.
hi @olibartfast
I downloaded the yolov4.wts file from tensorrtx-modelzoo
when attempting to create the .engine file in v1.3.0 I get this error:
Creating builder
Creating model
main: /yolov4-triton-tensorrt/layers/yololayer.cu:350: virtual nvinfer1::IPluginV2IOExt* nvinfer1::YoloPluginCreator::createPlugin(const char*, const nvinfer1::PluginFieldCollection*): Assertion `!strcmp(name, getPluginName())' failed.
Aborted (core dumped)
from yolov4-triton-tensorrt.
ok , which triton server release are you using to create the engine? The code in v1.3.0 is a bit old now unfortunately and doesn't support tensorRT 8 (i.e. Triton server > r21.06), I just tested myself and i created correctly the .engine using triton server r21.05
from yolov4-triton-tensorrt.
Im using nvcr.io/nvidia/tensorrt:21.05-py3
i will try triton server
from yolov4-triton-tensorrt.
I must been having hiccups with the .wts file, I'm getting the engine file now with the correct .wts file and tensorrt:21.05-py
Thank you
from yolov4-triton-tensorrt.
Related Issues (20)
- tritonclient.utils.InferenceServerException: [StatusCode.UNIMPLEMENTED] HOT 1
- yolov4-tiny model accuracy not right HOT 2
- Facing problem to create "engine" HOT 8
- multiple model instances issue HOT 15
- Feature: Import darknet weights instead of pytorch .wts HOT 1
- unexpected inference input 'data' HOT 2
- TensorRT 8 Support HOT 11
- Unexpected inference output 'detections' for model 'yolov4' HOT 1
- Dynamic batcing inference time HOT 1
- Support for TensorRT8 HOT 1
- [QUESTIONS] .wts file and plugin file HOT 3
- where is test time? HOT 1
- Can I use this repo to use custom trained yolo-v4 with single class HOT 1
- mismatch in postprocess func HOT 9
- Triton Inference Server taking adding 3 seconds to get YOLOv4 Inference HOT 7
- How can I generate batch=5 engine? HOT 1
- error: creating server: Internal - failed to load all models - NVIDIA Triton Server for YOLOv4 HOT 1
- Error : ld cannot find -lcudart HOT 2
- tritonclient.utils.InferenceServerException: [StatusCode.UNAVAILABLE] failed to connect to all addresses HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from yolov4-triton-tensorrt.