Comments (7)
Not all languages are supported right now, I'm actively working on supporting more languages
from whisper-diarization.
I am also willing to contribute for the same.
Just wanted little guidance.
from whisper-diarization.
Can you tell me how many languages are supported right now?
from whisper-diarization.
Right now word timestamps are generated using WhisperX, languages that are not supported in whisperx can be generated using Whisper Dynamic Time Warping, you can find tutorals for that on the original whisper repo, and supported languages are in the code
from whisper-diarization.
mn = "skylord/wav2vec2-large-xlsr-hindi" #@param
alignment_model, metadata = whisperx.load_align_model(
language_code=whisper_results["language"], device=device, model_name=mn
)
I have changes this line
it is used to take language specific model from hugging face
there are many language model available for many languages there
take model name from there that suits your language and put it in mn variable
and continue running...
WER will vary according to model you choose
from whisper-diarization.
You can modify this in whisperX repo, we import supported languages from there
from whisper-diarization.
@alloc7260 Hello, all languages that are supported in whisper are supported in the code now
from whisper-diarization.
Related Issues (20)
- Please include frozen or more restricted requirements.txt HOT 5
- Issue with an audio/video file HOT 1
- Numpy Conflict - current requirements.txt HOT 2
- Is this repo usable for a production use case!! HOT 7
- Error in diarization
- Installing from requirements.txt leads to the installation of ?every version of the packages needed HOT 7
- Audio only part time transcribed and each time a different one? HOT 3
- faster-whisper branch/revision has changed HOT 3
- diarize.py unexpected keyword argument ‘max_new_tokens’ HOT 4
- Error: got an unexpected keyword argument 'max_new_tokens' HOT 2
- AssertionError: chunk size too large, text got clipped HOT 2
- Language param not working HOT 2
- install issue HOT 1
- WhisperX forced alignment HOT 1
- How to use Yaml File HOT 1
- Failed to install on Apple Silicon HOT 7
- word_timestamps - IndexError: list index out of range HOT 1
- Transcription for non-verbal/non-speech labels(laughter etc.)? HOT 3
- Any suggestions for improving speaker diarization!! HOT 3
- Install fails on Python 3.12 due to missing distutils HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from whisper-diarization.