sharkyh20 / kinecttovr Goto Github PK

An open-source hook for VRInputEmulator to enable foot and hip tracking with the Kinect

kinecttovr's Introduction

KinectToVR SFML Version

This repository contains the original source of KinectToVR from Version 0.1 to 0.8 prior to the Qt rewrite.
Active development is done in the GitHub organization

KinectToVR is an application for emulating the functionality of Vive trackers using skeleton tracking from a Kinect for Xbox 360 or Xbox One, or using tracked devices from PSMoveService.

Build

You'll need:

Visual Studio 2019 (with: C++, v142 tools, ATL)
or just build tools for same (see GitHub Actions script)
Kinect SDK 1.8 & 2.0 installed and visible in PATH

Follow GitHub Actions script, or:

Clone Valve's OpenVR to external/ (eventually remove -master from folder name)
Restore NuGet packages for VRInputEmulator and KinectToVR
Build lib_vrinputemulator (another solution in external/) in x64/Release (It's set to Debug by default)
Build all in KinectToVR in x64/Release

Deploy

Retrieve the needed libraries either from your own KinectToVR installation folder or from the latest release
This also applies to OpenVR driver folders structure and files.

Credits

Sharkyh20 Original developer
公彦赤屋先 Maintenance and updates after 0.6.0r2
TripingPC Old installer, website and support
Himbeersaft Installer and support
コレヂャン Help with calibration maths

kinecttovr's People

Contributors

Stargazers

Watchers

Forkers

naelstrof mdovgialo mrbrian kaaori lukis101 cyhunter explife0011 untouchedodin0 arcadialabs linecode zchlovv akeia kittnz firearmofdoom wasd120d morristhehorris fuyukisakura ponsen bitcraft couteaucu adamlwalker nsmorales ectoo monica123m fwindpeak thiagorochadev gniang cyanobell amyharrison93 sshyran hex052 elypter kcbf doctourblack code-mirror treseizero myhamof cualquiercosa327 caduhd4

kinecttovr's Issues

Hello, I was wondering if you can fix the issue with kinect to vr? Apparently the new steamvr update broke this, and kinect is taking over input or something. Making the controllers useless when kinect to vr is on.

Kinect position and rotation

got everything working, actually even went ahead a step and hopped in vrchat and I can actually see the little white balls, problem is, on the adjusting the kinect position step, it simply wont move, I tried 3 different versions , 5.2, 5.5 and 5.6 and none of them I could get it to move or rotate, restarted my computer 4 times, checked to see if I have both visual studio, checked different boxes in different orders and nothing I do seen to make the arrow move, and it actually got to the point were I restarted the app so much that now the green arrow and the trackers don't even show up anymore

Left foot missing

as the title says, the left foot tracker is missing and I can't for the life of me figure out how to add it back in, OVRIE only gives 3 trackers, hips, right foot and kinect

I've installed the correct C++ drivers so that shouldn't be an issue (I specifically installed the ones given in the readme)

Please help me!

Suggestion for alternative application of this driver: seated locomotion

I think it will be possible to emulate what cybershoes(can be found at kickstarter) do, especially if you clip on some slippery material on your shoes.

Multiply Kinect's? And even with PS Move?!

Well, the Kinect V1 is actually pretty cheap, if you search well, you can get 4 of them for 70€ or less.
180° Tracking isent that nice, is there a Future in which K2VR will support using multiply Kinect V1 or V2 Trackers?

I know you are still working on Kinect support for the PS Move thingy, but my second Question would be if i could use the PS Move with multiply Kinect's, so that it tracks the Body and the Move at the same Time?

i can not calibrate or move the position of the arrow

KinectToVR crashing after spawning trackers

Hello. I have a problem with newer releases of K2VR.

While I am still able to use old version normally (version a0.5.5), and there's no problem with it, I wanted to DL and use the newest version. My problem is that whenever I try to spawn trackers in version a.0.6.0, K2VR crashes. Any ideas how I could try to solve this problem?

a.0.5.5 is the latest working version for me. And I have the nevest InputEmulator installed

Doesnt work with SteamVR1.14 as OpenVRInputEmulator crashes

as of 1.14, i haven't been able to get OpenVRInputEmulator to work as it crashes steam each time causing steam to enter safe mode.. Unless i am doing something wrong and someone has got it working with the current version? asked on their github too, awaiting reply.

Just stops working without a error message

When I open the Kinect1Vprocess for the xbox 360 kinect when steamvr is open, it loads, shows the program with only a white screen, and then closes without an error message. I ran it with steamvr not ruining and it said "Error 121" and "input emu status: NOT connected! Error 0 Could not open server-side message queue: the system cannot find the file specified.

SteamVR Update Issue

The new steamvr update seems to have broken the ability to adjust the position and rotation in kinecttovr.

Discord invite is broken

Discord invite in readme is expired.

Windows Mixed Reality controllers compatibility

there should be added compatibility with the windows mixed reality headset controllers.. To be able to move the kinect while in calibration mode

Color Tracking

Is there any way to use color tracking with led lights in kinecttovr?

do you have to have a set of vr controllers for this to work?

I was wondering if all I required was a kinect and a vr headset without the controllers

This app can't run on your PC.

I can't go anywhere past the a0.5.8 version without getting a popup saying "This app can't run on your PC", and I can't find any way to fix this issue.

Adds One Too Many Trackers

A common issue with a few tools I've used, sometimes it adds only 3 and everything is fine, but also sometimes it will add 4 breaking VRChat and a controller.

I am on WMR.

Trackers do not appear

So kinecttoVR is running and everything is installed properly. There are no errors, but kinecttovr doesnt spawn any trackers once im in VR. Is there any documentation on this?

- Sugestion - Support for Nolo VR

Hi!! Could be possible to have support for the NoloVR devices? Thanks!!

[Improvement/Support] Add joint tracker emulation for games that support it & Tracker Spawning Customization

So I was looking at the kinect skeleton, and it tracks quite a lot of points, and considering there are games that support more than 3 points of tracking, I was wondering if we could get a checkbox for enabling knees, elbows, and a chest, as those are all supported in NeosVR for instance, I would try doing it myself and making it a fork but I don't understand the coding language used well enough, though from what I can tell all of the joints are already referenced in the code. (better yet, allow us to disable feet and hips for hybrid setups, IE: 3 trackers for the main bits, and the other 5 points are based on kinect tracking, or 2 trackers for great feet tracking with a kinect based hip.)
Ideally every joint recognized by the kinect should be enableable/disableable via advanced settings for future proofing.

Hand tracker gets switched to random hip/foot tracker

as soon as I launch kinect2vr from my headset, i lose control of my left hand tracker.
When I look down, either of my feet or my hips will have taken it's place.

oculus rift with touch
kinect v 2.0

Unpowered???

ERROR E_NUI_NOTPOWERED the device is connected, but unpowered.

????????????????????????

What am i doing wrong??

wii controller

can i have my hand(positional tracking) with a wii controller and the 360 kinect?

usb compatibility

i think it is very important that you mention that you need a compatible usb host to use a KinectV2

https://social.msdn.microsoft.com/Forums/de-DE/bb379e8b-4258-40d6-92e4-56dd95d7b0bb/confirmed-list-of-usb-30-pcie-cardslaptopsconfigurations-which-work-for-kinect-v2-during?forum=kinectv2sdk

OculusGo controller calibration

Hi, I'm trying KinectToVR on OculusGo with ALVR.
I find it difficult to move an arrow of Kinect by one oculusgo controller.
All I can do is moving it up and down.
I guess if I have two controllers I can move an arrow right and left.
Do you have an idea to work calibration by oculusgo controller?

add openvr ver 1.2 support

add openvr ver 1.2 support by side to ver 1.3 for debug and issue fix purposes

Is one kinect better than 360 kinect?

I want to buy a kinect for this purpose, but I don't know which kinect is better for this. The 360 kinect is much cheaper than a one kinect but is it maybe worth the extra money?

dose KinectToVR havefinger and hand tracking

Installer attempting to access wrong user

When running the installer, while trying to access the openVR folder, the installer attempts to access user Admin instead of the current user, where the openVR folder is. I am running the installer from the correct user, and I am not sure what the problem is.

Azure Kinect compatible

Will it be usable with Azure Kinect?

White arrow for Kinect Acting as hip tracker

Exactly the title, my hip tracker was replaced with the white arrow, not a duplicate, but the same one randomly, not after tinkering with settings. the arrow moved with my and was was facing upwards. using xbox 360 kinect, and was fixed with a restart of the program

Jittery legs / low hip

Hey there.
Been trying to set this up and have come across 2 issues that translate poorly into VRChat.

I'm working with a Rift + touch + kinect 2.0
When doing the initial setup and calibration, I notice that the skeleton track is VERY jittery during the preview. Not smooth like in your youtube video.

Second, my hip is very low, pretty much down to my crotch.

The jittery effect appears to happen in VRchat as well as does the height of my crotch.
Am I doing something wrong?

Right shoulder dislocated

Hi,

I'm having the issue that when KinectToVR enabled, the right shoulder seems to be dislocated or has an offset. Without everything is fine. Visible in the following images:

I've just installed my whole system from scratch and have everything latest installed:
Windows 10 - 1809
Kinect v2 - latest SDK
Latest VS-Studio Community
Steam VR - 1.3.23
Oculus Runtime - v1.7.11
KinectToVR - a0.6.0 Prime-time Test R2
OpenVR Input Emulator - v1.3
InputEmulator SteamVR Fix is applied

Config:

{
    "kRotation": {
        "value0": 0.21420025825500489,
        "value1": -0.006894811987876892,
        "value2": 0.0
    },
    "kPosition": {
        "value0": -0.0597340427339077,
        "value1": 1.238244891166687,
        "value2": -1.904710054397583
    },
    "hipRoleHeightAdjust": 0.19999992847442628,
    "globalFontSize": 12.0,
    "secondaryTrackingOriginOffset": {
        "value0": 0.0,
        "value1": 0.0,
        "value2": 0.0
    }
}

Also I have to configure the the Kinect sensor with an offset, even when the readme says to match the arrow as close to the real world as possible. It ~20 cm below at a bit to the left so the hip and feet match up.

Any advise?

what about webcam

well kinects are pretty expensive now (depends on country). Does kinecttovr works on webcam cuz Driver4vr seems to work- i did not try i just saw on vid-. İf it doesnt do you have any alternatives for a webcam

Problem with visual on camera Driver4VR and PSMoveService

Hi everyone.
I've configured my PSVR with both Trinus and Driver4VR. When I'm in the Steam Room, it's all ok. The problem is with BeatSaber. During the gameplay, the visual starts to move, so I'm constricted to chin up. Other times, the visual starts to incline, causing me motion sickness. I think that the problem is the setting of the Kinect360 witch Driver4VR but I don't know what. I followed the tutorials and those videos were very simply, because the guy just opens the software and all is ok ahahah.
Can I get some help please?

Other problem concerns in pairing my PS Move to PC with PSMoveService. It gives me an error: failed to pair. How can I solve that?

Sorry for all these problems but I'm excited to use the PSVR on PC ahahah

Unable to move arrow to Windows Mixed Reality

Hello sharkyh20, I'm trying KinectToVR on Windows Mixed Reality
I can't move the Kinect arrows from any version of KinectToVR by TouchPad on Windows Mixed Reality Motion Controller.
Are there other methods of calibration?
Do you have an idea to work calibration by Thumbstick or Buttons on the TouchPad?

Dosent work with upside down kinect

how can i do to get the tracking with upside down kinect ?

Can't disable rotation for xbox one kinect.

Feet rotation is pretty janky and having an option to turn rotation off would be nice.

Is it possible to build it for linux?

there is the freenect driver for the kinect and there is steamvr for linux. both are working for me so i thought i could try this out. is it possible to build it on linux?

Not responding

When I try to open the Kinectv1process it just opens a white screen and says not responding. Nothing happens after that. Does anyone know how to fix this?

Less of an issue and more of a question: Will this support using multiple kinect sensors for increased accuracy and 360 degree tracking?

I know there are programs that make use of multiple kinect V2s to capture motion for use in blender, would be cool to see it done with this as well.

Input Emu Status: NOT Connected! Error 0 Could not open server-side message queue: The system could not find the file specified

360 kinect working just fine. tested with a scanning application.
Yes, input emulator 1.3 is installed
Yes, input emulator dll fix has been applied
I have had this working in the past but have never had this problem before.

I get the same error for any version release i try. I've tried every stable release that is available.

all instructions on this project's main page have been followed to the letter three times, twice after reformatting the computer each time. please let me know what other information i can provide to help troubleshoot this issue.

Hangs when starting with SteamVR running

KinectToVR-a0.5.8 Performance Degradation Patch 2 hangs with a white window if SteamVR is already rnning when starting it like you are supposed to. when i start it without SteamVR then the interface loads bt obviously without a connection to SteamVR. the kinect360 is detected. the newest version crashes regardlessly and the window closes automatically if steamvr is not running.

Oculus Support?

Does this work for oculus, or just steamvr, I wanna use my kinect for full body tracking in bea tsaber, but I have the oculus version, and I prefer it

crash when SteamVR is in Safe Mode

In the latest version K2VR crashes if SteamVR is running in Safe Mode. in older ones it shows an input emulator not found error in the ui. If this is unavoidable please add this bit of info to the tutorial.

tracking for smaller rooms/only needing waist and feet for tracking.

when I tried using it, it could see my feet and waist perfectly. (and even most of my chest/above my waist.) but because my hands and head were a little bit out of frame and the tracking just didn't quite work. At the moment I can almost get it to work with only this and a little messing with the offsets. In short, I feel like there should be a way to track only what you need and not what's already being tracked, e.g. in my case my cv1 touch controllers are already being tracked, and the headset with the sensors.

I know this sounds a little redundant because that's what it already does but I saw in a tutorial that you need at least 3 meters of distance for it to work properly, but the max distance for my room is 2 meters (and that's maxed so it needs to track less than that) so if it could track in a distance with 1 meter and not needing to have my head/hands in frame to track properly and work this would be fixed. hope that makes sense.