rolker/opencv_dnn

Uses OpenCV to run a neural net emulating darknet_ros' interface

ROS package for using OpenCV's DNN capability

Usage

Plugins are used for processing the output on the network. Available plugins are:

• opencv_dnn::YOLOv8Parser (default)
• opencv_dnn::YOLOv5Parser

Topics

Input topic:

• image

Output topics:

• ~/detections
• detection_image
• ~/class_labels

Parameters

• model
• model_path
• configuration
• configuration_path
• detections_parser
• threshold
• nms_threshold
• class_names
• input/width
• input/height

ROS noetic

For building on Ubuntu 20.04, an updated OpenCV (4.5+) is needed.

Cuda

If using cuda, you may want to install the latest version.

To see what's installed:

apt list --installed | grep cuda

From https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu

sudo apt-key del 7fa2af80
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt update

Note, for Jetsons, use the appropriate architecture:

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/arm64/cuda-keyring_1.1-1_all.deb

As of this writing, OpenCV will not build using Cuda 12.2, so install 12.1.

sudo apt install cuda-12-1

Remove metapackage that installs latest cuda:

sudo apt remove cuda
sudo apt autoremove

Add following to ~/.bashrc and make sure to source it or reboot.

export PATH=/usr/local/cuda-12.1/bin${PATH:+:${PATH}}

Clone OpenCV from github

cd ~/src
git clone https://github.com/opencv/opencv.git
git clone https://github.com/opencv/opencv_contrib.git
cd opencv
mkdir build
cd build

Without cuda:

cmake ../ -D CMAKE_INSTALL_PREFIX=~/.local -D OPENCV_EXTRA_MODULES_PATH=../../opencv_contrib/modules

With cuda:

cmake ../ -D CMAKE_INSTALL_PREFIX=~/.local -D OPENCV_EXTRA_MODULES_PATH=../../opencv_contrib/modules -D OPENCV_DNN_CUDA=ON -D WITH_CUDA=ON

OR with cuda but leaner for faster build: cmake ../ -D CMAKE_INSTALL_PREFIX=~/.local -D OPENCV_EXTRA_MODULES_PATH=../../opencv_contrib/modules -D OPENCV_DNN_CUDA=ON -D WITH_CUDA=ON -D BUILD_opencv_python2=OFF -D BUILD_opencv_python3=OFF -D BUILD_TESTS=OFF

make -j4
make install

This will install OpenCV in ~/.local

To avoid link errors, the vision_opencv package should also be built against this alternate OpenCV so clone it into your workspace.

https://github.com/rolker/vision_opencv

Weights

See onnx model zoo

Parsing class labels from ONNX

The src/onnx/onnx.proto file was copied from: https://github.com/onnx/onnx/blob/main/onnx/onnx.proto

Docker

To build the docker image.

docker compose build

Start the dev container

docker compose up -d dev

or

docker compose up -d dev-nvidia

To open a shell in the dev container

docker exec -it opencv_dnn-dev-1 /bin/bash

opencv_dnn's Issues

Update README with Jetson instructions

arm64-Jetson repos:

native: $distro/arm64

Update to use vision_msgs

http://wiki.ros.org/vision_msgs