macoron/piper.unity

Running text to speech model (Piper) in Unity3d on your local machine.

piper.unity's Issues

Looking to open up the Phoneme timings.

Thanks so much for your integration of Unity/ONNX and Piper!

I'm trying to see how to get the actual phoneme timings out and I'm reading through how your scripts contact the ONNX model and I'm not sure where to put things but it'd be nice to spit out one extra float array of the individual appended phoneme lengths so the voice output can be visually synced to viseme output on an avatar.

Any clues how to attack that? It's literally just adding one final output float array in the right spot to grab - no need to edit the model or tensors or anything like that.

How do I use this with Voices that have multiple Speakers such as en-US arctic and libritts_r?

I believe the input Dictionary in PiperManager.TextToSpeech() needs an "sid" entry but I haven't figured out what values it wants for it in order to work.

Great project so far.

App crashes when Voice error occurs

When i call PiperNative.process_text method and pass an invalid voice such as “en-US" , the application was crashed. My guess is that the C++ part should not throw exceptions.