Better Voice Activity Detection (VAD) (volume threshold) algorithm?

[wofwca]

Better Voice Activity Detection (VAD) (volume threshold) algorithm?

[zznidar]

I was thinking about doing some frequency comparison. Maybe by getting the ratio between certain frequencies inside human voice range and outside of it. Some research would be needed, though, to find the right values. Also, non-instrumental music would probably cause some problems.

[WofWca]

Finding an existing one would be cooler, at least in other languages, or at least in maths form.

[Kj-is-escape]

What exactly are we looking for, would something like webvoicesdk be it? the demo seems to do what we are looking for.

[WofWca]

What do you mean? The pros and cons in the issue description should give a rough idea.
Have you looked further into tech specs of the library you suggested, how it's better than what we have now? Based on the demo it seems to also get activated by music.
Anyway, thanks for suggestion.

[Kj-is-escape]

I didn't look much into it.
"State of the art Recurent Neural Network that uses WebAssembly portable runtime for voice activity detection." gave me the idea that it was taking into account more than volume.
I think "finding something that doesn't get activated by music" is a good way of measuring it.

[WofWca]

People who use NewPipe say that it does its job well (also it doesn't requre the user to specify volumeThreshold), so maybe copying their algorithm would be enough. It uses ExoPlayer, where the silence skipping feature is implemented:

https://github.com/google/ExoPlayer/blob/ab4d37f499ba49bb3cac7938eb03ebf7133ccfe6/library/core/src/main/java/com/google/android/exoplayer2/audio/SilenceSkippingAudioProcessor.java

Also see vantezzen/skip-silence#36 (adaptive (dynamic) volume threshold)