Comments (7)
What does 'unintelligible speech' mean? Can I see your training logs or Tensorboard?
We have used about 60 hours of Hindi data from LIMMITS and have experience using phonemizer. Have you checked if tokens were properly extracted during the training and inference stages?
from hierspeechpp.
Hi
I have attached tensorboard loss curves for our TTV v1 model which was trained with LibriTTS-960 dataset.
we used 4x GPUs with 128 batch size (32 per GPU).
How about the ctc loss curve you trained? Our checkpoint is from 930k steps.
and
I actually do not know Hindi language well... but I think Phonemizer may not be good for Hindi Language. In this case, how about using other tokenizer?
from hierspeechpp.
We have used phonemizer as well, and from past experience, it works decently for Hindi as well.
Here are my logs:
"unintelligible" means like it sounded like it was speaking clearly but nothing related to the text and not in the language. But again, it was just with 20k steps checkpoint.
from hierspeechpp.
@hayeong0 from how many steps onward we start getting some audible voice when train TTV from scratch ?
from hierspeechpp.
Just for reference, the audio from 20k steps.
hierspeech_mms.mp4
from hierspeechpp.
Here is our results from 10k, 20k, 50k, 100k, 200k, 950k. (with hierspeech synthesizer v1)
I have attached audio for some text and speaker of libritts-test-clean.
When using LibriTTS dataset, the 10k steps model can synthesize an audible speech.
Thanks!
from hierspeechpp.
Thank you very much, it helped.
from hierspeechpp.
Related Issues (20)
- tensor mismatch size in commons.rand_slice_segments(w2v, length, 60) HOT 7
- inference error HOT 1
- Problem in english cleaners HOT 2
- Upload model weights to Hugging Face Hub!
- would it be possible to provide a version without restrictive training data HOT 1
- Prosody Encoder HOT 4
- cant replicate the training curve for libritts 960 HOT 2
- Missing keys in checkpoint file HOT 2
- Random pauses in between the sentences HOT 2
- Are you planning to add support for the Ukrainian language? HOT 2
- Long text inference
- Hi, Can you please provide instructions for training process and dataset requirements? HOT 2
- Timeline for Multilingual TTV model
- Multi Scale STFT Discriminator checkpoint HOT 2
- Can this work on a cpu without cuda? HOT 1
- training TTV HOT 3
- DWT D?
- Possible inconsistency between SpeechSR implementation and paper description HOT 3
- monotonic align not found at ttv_v1/t2w2v_transformer.py HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hierspeechpp.