federicohyo/ofxsiliconretina

openFrameworks addon for interfacing to the Dynamic Vision Sensors. This addon is a basic logger and player for the DAVIS/DVS sensors family

ofxSiliconRetina

The statistic panel shows the display running only at about 60 fps. Nonetheless, the event-data are being timestamped with a single micro-seconds (us) resolution (see https://inilabs.com/products/dynamic-and-active-pixel-vision-sensor/).

This shows the output of the mesh example. The image can be rotated and translated using the mouse, in addition several parameters can be tuned by using the hotkeys (m,k,j,h).

This shows the GUI interface that can be used to check live data, load recordings or make recordings. Many parameters are available to the user; such as enable/disable APS,IMU,DVS, pause, playing speed etc. The GUI can be hidden or displayed if the "c" key is pressed.

Introduction

This addon let you interface any Dynamic Vision Sensor to openframeworks. The Dynamic Vision Sensors are frame-free vision sensors invented, produced and developped by inilabs.com.

License

ofxSiliconRetina is distributed under the MIT License, and you might consider using this for your repository. By default, license.md contains a copy of the MIT license to which you can add your name and the year.

Installation

Copy this addon inside the folder openFrameworks/addons/.

This addons depends only on ofxStats, available here: https://github.com/tado/ofxStats

Dependencies - included in this package -

This addons includes libcaer and libusb, if missing the one from your architecture. Please compile and copy them into the libs folder.

libcaer can be obained here: https://github.com/inilabs/libcaer libusb can be obtained here: https://github.com/libusb/libusb

HotKeys

s: enable/disable stats

d: enable/disable dvs

a: enable/disable aps

i: enable/disable imu

s: start/stop recording files*

n: load recording file

+: faster playback

-: slower playback

• aedat3.1 file format: https://inilabs.com/support/software/fileformat/

Compatibility

Tested on OF release 0.9.x

Known issues

Please select the correct device by changing the definition line in ofxSiliconRetina/src/ofxDVS.hpp

PLEASE SELECT SENSOR FAMILY DVS128 / DAVIS (FX2/FX3) #define DAVIS

Version history

(25 May 2019):

Compatible with libcaer 3.1.0 (this version works with logic 18.0 and firmware 5). These versions are the only one that currently work both in libcaer (3.1.0) and jAER.

(2 June 2017):

Added aedat3.1 recording and playback capabilities (very limited in playback, no time or slow down control possible).

(27 May 2017):

Added shader example, added keyboards shortcuts, and reduced usb latency (now it uses threads)

(25 May 2017):

Implemented frames, imu6 events

(25 May 2017):

Implemented polarity events for DVS128, DAVIS240, DAVIS346B

(12 Feb 2023):

Implemented polarity events for DVXPLORER