Comments (3)
Hey @Akira4ever - The code assumes vocoder checkpoint has states stored in 'generator' field. Could you print out checkpoint.keys() in the line throwing error above and see what fields it has in your checkpoint?
Looking at what you've done, one worry I have is you might hardcode file path of the UnitY model in fairseq2/models/utils/model_loader.py but the model loader file is shared with vocoder. If you'd like loading from local path instead of downloading on the fly, you could also update the yaml file with local paths as #50
from seamless_communication.
Thanks! I indeed changed file path of the model and maybe that's the reason. : (
from seamless_communication.
you might hardcode file path of the UnitY model in fairseq2/models/utils/model_loader.py but the model loader file is shared with vocoder.
And it's because I didn't download the vocoder model from huggingface...But #50 also helps me. Thank you!
from seamless_communication.
Related Issues (20)
- tensor format input audio translation error
- $$ FineTune Not Work !
- [help] libsndfile is not found | mac m1 proMax, sonoma14.4 HOT 1
- T2TT not works
- Cannot finetune TEXT_TO_SPEECH and SPEECH_TO_SPEECH HOT 1
- آیا شما توانسته اید یادگیری مدل را اصلاح کنید ؟؟؟
- How use checkpoints that i got from fine-tuning??
- I am going crazy waiting for the training and fine-tuning code for the SPEECH TO SPEECH task
- Norwagian Language Not supported this model
- Does t2tt and t2ts support real-time streaming generation? HOT 2
- Seamless Streaming using microphone input
- Does the Seamless encoder participate in parameter updates during X2TT training?
- MuTox Dataset Annotated Timeline not matching
- Cannot install packages
- Broken hugging face link
- stdlib.h, error: command '/usr/bin/x86_64-solus-linux-gcc' failed with exit code 1 HOT 1
- seamless_streaming_unity相关权重自行下载,怎么设置路径 HOT 1
- streaming_evaluate --task s2st --data-file ../input_1.wav --audio-root-dir ../ --output ./ --tgt-lang eng --expressive --gated-model-dir ./SeamlessExpressive 2024-07-09 12:55:04,014 INFO -- seamless_communication.streaming.agents.unity_pipeline: Loading the UnitY model: seamless_streaming_unity on device=cuda:0, dtype=torch.float16 Killed
- about tsv file HOT 1
- REDACTED HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seamless_communication.