Comments (5)
astrowar
commented on July 16, 2024
1
I tested it on a jetson orin nano. The medium and large models exceed the amount of memory available.
The small model takes 47s to translate a 5s audio and uses 2GB (inference only, the model loads is fast < 7s). The audio output has good quality. The translation gets a little sluggish on the first word in some tests. but the overall result is good in the two languages I tested.
To work you need to add the resample to 16Khz in the input
from seamless_communication.
Juan1108888
commented on July 16, 2024
I also want to know!
For small models, maybe try
from seamless_communication.
Juan1108888
commented on July 16, 2024
How ASR and T2ST?
from seamless_communication.
cndn
commented on July 16, 2024
Hey @kiashann - we don't have active plan to support specific hardwares. If you're able to get our project working on a new hardware platform or have insights on improvements, would be appreciated if you could contribute knowledge!
from seamless_communication.
sytpb
commented on July 16, 2024
how about the raspberry PI5 , focus on it .
from seamless_communication.
Related Issues (20)
- NotImplementedError: T2U finetuning implemented only for UnitYT2UModel why??!!
- How to segment hate speech downloaded from the Mutox dataset tsv file HOT 5
- Tensor device mismatch in Transcriber
- Why?
- posible text to speech fineTune ??? HOT 2
- The large version will crash out even on Colab A100. Maybe trying using the medium version. HOT 1
- Train NEW
- FineTune on TPU?
- Please explain this part of the code to me
- Odd results in ASR. Does it have a chat language model and text smoothing?
- Fine Tune Not work for text to speech ??????????????????????????????? HOT 2
- Why the extract_alignment function does not return times?
- After downloading the seamless-m4t-large model file, not able to inference from local files.
- Sequential Execution of translator.predict() in Multithreaded Environment
- Incorrect output for T2TT between English and Japanese on MPS backend. HOT 1
- M4T V2 --- Do you know how to teach the TEXT_TO_SPEECH ?? Does that mean no one has done it or you don't want to give me a guide? Thankful
- Any plans to release finetuning script for Seamless Streaming?
- text to text not showing even as an option m4t_predict: error: argument --task: invalid choice: 'T2TT' (choose from 'ASR', 'S2ST', 'S2TT') HOT 2
- Is there a person in this desert who can answer me? HOT 2
- I can't run bash script for generate dataset for fine-tuning m4t model!
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seamless_communication.