summersigh/projectbabble

An Opensource mouth tracking method for VR

Table of Contents

• What is Babble?
• Features
• How do I set it up?
• Useful Links

What is Babble?

Babble is an opensource mouth tracking project designed to work with any existing VR headset. We strive to make our models robust to different lighting, cameras, image qualities, and facial structures!

Features

• 100% Opensource! 🌟
• Fast and robust! 🚀
• Works with most existing blendshape standards! ⚙️
• Constantly updated and modified! 🔧

Setup (More detailed wiki and setup video coming soon!)

To install babble is fairly simple! Head over to the releases tab and download the EXE located there. Run the EXE and install babble! After that, you can test with a USB WEBCAM by doing the following steps:

• Run the babble app
• Enter 0 into the camera address bar
• Enter cropping mode where your camera feed should be
• Crop your mouth out of the frame
• Open VRCFT
• Install the babble module
• Test in VRC with a VRCFT-compatible avatar

Useful links

• Our Discord!
• Wandb Runs

projectbabble's Issues

No license defined

Project is described as open source, yet there is no open source license specified.

Quest Pro Support

Does project babble support quest pro inputs, I'm trying to use it to get face tracking in Resonite

How do I fill in the address for the HP Reverb G2 Omnicepts webcam?

https://docs.vrcft.io/docs/hardware/Project%20Babble/babble-omnicept
I was watching the VRCFaceTracking tutorial and noticed that OBS was having problems after creating the virtual camera. Not sure how to proceed to the next step.
The main thing is that the camera address is not known how to be filled in.