kosmonaut3d/fusioncompute

Kinect Fusion realized with OpenGL Computer Shaders

Fusion Reimplementation

Overview

This program implements a full Kinect Fusion algorithm, realized in OpenGL with ComputeShaders. It is based on the original paper and the follow up by Microsoft Research.

The algorithm works by processing a stream of depth images and building a coherent model of the full scene by merging all data into a single representation structure continuously in real time, while also providing a highly accurate pose estimation of the camera.

As part of my thesis I implemented all of the core Kinect feature set in OpenGL compute, as well as having most parts implemented as a CPU reference, apart from the SDF integration and reference for ICP, due to performance limitations since the systems only work with a high enough framerate and the naive single-threaded CPU implementation can not keep up.

The program can be controlled with mouse input, using a comprehensive GUI.

Locations

The compute shader code can be found in /resources/shaders.

The .cpp source code is located in /src

Getting Started

External Dependencies

The input used is a first-generation Kinect camera, but the algorithm can easily be adapted for any RGB-D input (with known camera parameters).

The application is built upon OpenFrameworks, which is a very thin, easy to use open source platform that is compatible with numerous operating systems and used for general visualization.

For access to data from the Kinect sensor, OpenFrameworks by default supplies a wrapper for libfreenect. The user's system must be setup with the correct open drivers, a guide can be found here: https://openkinect.org/wiki/Getting_Started

The Eigen library is used for decomposition of linear systems and comes pre-installed in /deps/Eigen

For the GUI a simple Dear Imgui wrapper is used, which comes as an openFrameworks addon.

Compilation

For compilation OpenFrameworks has to be installed and the OpenFrameworks Project Generator can then parse the folder and setup the locally used IDE for compilation.

The usual setup is to add the project to

openframeworks/apps/myApps/

For this path configuration there are provided solution files for Windows (Visual Studio 2019) or Linux (QTCreator).

Binaries

You can find Windows binaries linked in the github release.

fusioncompute's Issues

Should work as the oF Kinect example does?

Hello, thanks for sharing!

Should this work with the first Kinect, right? (Not the newer Kinect One.)
I am trying to make it work on oF 0.11+ / Windows 10 / VS 2022 / debug/release 32/x64.

Also, I assume that uses the same driver as the oF Kinect bundled example?
I mean, that if that Example works, this repo should work too?

I downloaded the release folder into the project and it opens, but it seems like the driver is not detected properly.

I am reinstalling the driver (libsub) using the Zdig app as usual, bc now the oF example project is not working either.

In resume, once the oF example works should your repo work too, right?
Or it's using a different driver/approach?