antoan/duo3d_driver

ROS Driver for DUO

#DUO3D Driver for ROS

The duo3d_driver ROS node interfaces with DUO SDK and publishes stereo images, disparity, point cloud, and IMU data from the DUO3D sensor. This package is build on Ubuntu 16.04.1 LTS x64 running ROS Kinetic.

##Introduction The DUO MLX is an ultra-compact imaging sensor with global shutter and a standard USB interface for ease of use and connectivity. The DUO is intended for use in research, autonomous navigation, robotics and industrial areas. The camera's high speed and small size make it ideal for existing and new use cases for vision based applications.

With a programmable illumination board and built-in IR filters and auto-exposure it allows for precise control of lighting environment, delivering configurable and precise stereo imaging for robotics, inspection, microscopy, visual odometry, human computer interaction and beyond.

The DUO MLX solution consists of:

• Factory Calibrated Stereo Camera
• Industrial Grade Monochrome/Global Shutter Sensors
• Integrated Accelerometer/Gyroscope/Temperature (6 DoF IMU)
• Fully Programmable Active LED Array (3xIR 850nm High Power LEDs)
• DUO SDK License
• DUO Dense3D License
• USB Mini-B Cable

The DUO line of sensors offer a versatile board level solution for 3D sensing, a solution equipped with IMU and IR illumination and a board level sensor with an aluminum enclosure and a complete system for utilizing stereo vision that comes with a DUO MLX sensor and the DUO VPC processor. All DUO sensors are ready to work right out of the box and support a wide range of accessories and configurations.

For more information visit DUO3D Home Page

##Installation

###DUO SDK The DUO SDK package is required for DUO device support under your Linux operating system. It consists of kernel module and user mode libraries that expose all of the DUO functionalities with a simple and concise C/C++ API. Included in the package is the Dense3D™, an SIMD/NEON optimized multi-threaded library that performs the disparity and 3D data extraction from DUO stereo image pair.

• To download the DUO SDK visit the Download page
• To install the DUO SDK follow the Install guide

###DUO ROS package DUO ROS driver is developed and supported in ROS Kinetic.

Get the package from github and put it in your catkin workspace ''src'' folder:

$ cd ~/catkin_ws/src
$ git clone https://github.com/duo3d/duo3d_driver
$ chmod a+x cfg/Duo3D.cfg

Build the package:

$ cd ~/catkin_ws
$ catkin_make duo3d_driver
$ source ./devel/setup.bash

###Published Topics The duo3d_driver node interfaces with DUO SDK and publishes images, disparity, point cloud, and IMU data from the DUO3D sensor.

• /duo3d_driver/left/image_rect (sensor_msgs/Image) Left camera rectified image
• /duo3d_driver/left/camera_info (sensor_msgs/CameraInfo) Left camera info
• /duo3d_driver/right/image_rect (sensor_msgs/Image) Right camera rectified image
• /duo3d_driver/right/camera_info (sensor_msgs/CameraInfo) Right camera info
• /duo3d_driver/rgb/image_rect (sensor_msgs/Image) Left camera RGB rectified image
• /duo3d_driver/rgb/camera_info (sensor_msgs/CameraInfo) Left camera info
• /duo3d_driver/depth/image_raw (sensor_msgs/Image) Colored disparity image
• /duo3d_driver/depth/camera_info (sensor_msgs/CameraInfo) Disparity info
• /duo3d_driver/point_cloud/image_raw (sensor_msgs/PointCloud2) DUO 3D point cloud data
• /duo3d_driver/imu/data_raw (sensor_msgs/Imu) DUO IMU data

###Parameters

• ~frame_rate (double, default: 30) DUO image capture frame rate
• ~image_size (vector, default: {640,480}) DUO image frame size
• ~dense3d_license (string) Dense3D license string
• ~gain (double, default: 0%) Image gain value [0, 100]
• ~exposure (double, default: 50%) Image exposure value [0, 100]
• ~auto_exposure (bool, default: False) Image auto exposure value [False, True]
• ~camera_swap (bool, default: False) Image swap [False, True]
• ~horizontal_flip (bool, default: False) Horizontal image flip [False, True]
• ~vertical_flip (bool, default: False) Vertical image flip [False, True]
• ~led (double, default: 10%) LED brightness value [0, 100]
• ~accel_range (int, default: +/-2g (0)) Accelerometer Range [+/-2g (0), +/-4g (1), +/-8g (2), +/-16g (3)]
• ~gyro_range (int, default: 250deg/s) Gyroscope Range [250deg/s (0), 500deg/s (1), 1000deg/s (2), 2000deg/s (3)]
• ~imu_rate (double, default: 100Hz) IMU Data Sampling Rate [25, 500]
• ~processing_mode (int, default: BM (0)) Dense3D Processing Mode [BM (0), SGBM(1)]
• ~image_scale (int, default: ScaleXY (3)) Dense3D Image Scaling Mode [ScaleNone (0), ScaleX (1), ScaleY (2), ScaleXY (3)]
• ~pre_filter_cap (int, default: 28) Dense3D Pre-filter cap [1, 63]
• ~num_disparities (int, default: 4) Dense3D Number of disparities [2, 16]
• ~sad_window_size (int, default: 6) Dense3D SAD Window Size [2, 10]
• ~uniqueness_ratio (int, default: 27) Dense3D Uniqueness Ratio [1, 100]
• ~speckle_window_size (int, default: 52) Dense3D Speckle Window Size [0, 256]
• ~speckle_range (int, default: 14) Dense3D Speckle Range [0, 32]

##Testing the DUO ROS package Make sure that DUO device is plugged in the USB port and it is operating properly.

###DUO ROS Camera Example This example demonstrates the acquisition of rectified stereo image pair from DUO. To launch DUO Camera ROS example, in a terminal run the following command:

$ roslaunch duo3d_driver duo3d_camera.launch

You should see the following:

###DUO ROS IMU Example This example demonstrates the DUO's on-board 6DoF sensor fusion using Madgwick algorithm running at 100Hz. To launch DUO IMU ROS example, in a terminal run the following command:

$ roslaunch duo3d_driver duo3d_imu.launch

You should see the following:

###DUO ROS Point Cloud Example This example demonstrates disparity and point cloud generation using DUO. To launch DUO IMU Point Cloud example, in a terminal run the following command:

$ roslaunch duo3d_driver duo3d_depth.launch

You should see the following:

##Getting Help

• For general help regarding DUO, you can visit the official DUO forum
• For more information about DUO API please visit DUO SDK
• For ROS specific issues, please open a ticket