Comments (14)
Great news: I contacted Smith Micro again on a different channel, and this time I received a very nice reply with a full Moho license. So I'll be able to test the new format with both applications after all! 😄
from rhubarb-lip-sync.
It took a while, but the exporter for Moho and OpenToonz is done. I'll release a new version soon.
from rhubarb-lip-sync.
I think writing a Moho exporter shouldn't be hard. The main problem for me is that I don't own Moho. So I wouldn't know whether the export works. Here are some points I'm not sure about:
- What's the expected frame rate? Is it some fixed value (24? 30? 60?) Or can it be configured?
- If the frame rate is not fixed, is there a way of including it in the switch file? Should I introduce a CLI option to specify it? Can I get away with a fixed value?
- What set of mouth shapes should I use? Rhubarb uses the industry standard A, B, C... identifiers used by most animated TV series. Many Moho users seem to use Papagayo, which (in its not-NG form) has hard-coded identifiers inspired by the Preston Blair books. Should I try to convert the Rhubarb identifiers to Preston Blair identifiers? Or is it fine for Moho users to adopt the industry names?
If I had to convert the identifiers, this is how I'd probably do it:
Rhubarb identifier | Moho identifier |
---|---|
A![]() |
MBP![]() |
B![]() |
etc![]() |
C![]() |
E![]() |
D![]() |
AI![]() |
E![]() |
U![]() |
F![]() |
WQ![]() |
G![]() |
FV![]() |
H![]() |
L![]() |
X![]() |
rest![]() |
n/a | O![]() |
from rhubarb-lip-sync.
Dear Daniel,
Thank you for responding so quickly. Getting a 30 day full working demo for Moho 12 would be easy. This should be OK for testing. You can get it here:
https://my.smithmicro.com/moho-pro-12-trial.html#trial
I'm no Moho Professional, so i can't talk for all Moho-users, but these are my suggestions:
-There is no fixed frame rate. Users can set any frame rate in the project settings. I would suggest 24 as a default and any other value as a parameter.
-I'm not sure about the answer to the second question. As far as i know, the only content of a swith file i the time stamp in frames per seconds in the first row and the name of the correspondig image in the second row (and MooSwitch1 in the header). So Moho uses this for the selected frame rate in the project.
-Yes, Moho users often work with the papagayo-output and as far as i know, papagayo was initial written by someone from anime studio. The integrated Moho lip syncing features follow standards developed by Preston Blair too. But it is possible to use any files for the different mouthtypes, so it should be possible without any problems to use industy-standard too.
The only thing to do is to rename the used grafics as expected.
But in case of usabillity and acceptance it would be a good idea, having the possibilyty for a conversion e.g. to Preston Blair. The reason for this is the fact, that the users has build and named the files for the mouths for that, as you assumed.
Your suggestion for a conversion is fine, a good idea.
from rhubarb-lip-sync.
Sorry for the late response. I think I will implement Moho support, but it might be a few weeks before I find the time.
from rhubarb-lip-sync.
Dear Daniel,
these are good news! I think a ot of users will be very happy about it.
best regards
Norbert Linda
from rhubarb-lip-sync.
OpenToonz can use the .dat file for lip sync too. Since the last macOS Papagayo release is really old, it only partially functions. It would be great to have another option!
from rhubarb-lip-sync.
That's good to know! I'll try to make sure the output works with both programs.
I'm blocked right now because I can't get a functioning version of Moho. The demo is useless for my purposes -- it won't even allow me to import audio files. So I contacted Moho, asking if I could get a free version. That was ten days ago, and I haven't heard back from them.
If I'm to implement the Moho exporter, I need a functioning version of Moho so that I can test it, take screenshots for documentation, and maybe create a tutorial video. But I don't want to pay $70 for an application I won't use.
from rhubarb-lip-sync.
OpenToonz uses the exact same .dat file from Papagayo as Moho - so you could probably start the process with OpenToonz. It's free!
In OpenToonz, the default frame rate is 24fps but it can be changed. The frame rate is not included in the .dat file. If using a different frame rate than 24fps, you would probably have to set it in the lip-sync program and again in the OpenToonz scene for the timing to work.
Right now, OpenToonz uses Preston Blair identifiers for lip syncing.
from rhubarb-lip-sync.
As far as i know, the most open source programs are able to use the papagayo format. E.G OpenToonz is a candidate, synfig studio is another. I am sorry about the Moho-Trial, It have not known, that there is so much limitation. I can't understand, that you have not received a free version from Smith Micro, this is a bittle bit ignorant, if they really would not react..
By the way, a full version of Moho Pro costs about 400 Euro and 70 Euro for Moho Debut.
from rhubarb-lip-sync.
Hey...that's perfect. I was sure, that you will get a license. Everthing else would be crazy from Smith Micro in thei own interest. Good luck!
from rhubarb-lip-sync.
I'm looking forward to trying this out. Are there any installation steps specific for macOS? I've unzipped the release folder and I'm using Terminal (on Mojave 10.14.5) but no matter what I try, all I get is:
-bash: rhubarb: command not found
Maybe I've missed a step?
from rhubarb-lip-sync.
Rhubarb is a command-line tool. You need to add the directory containing the rhubarb
executable to your PATH variable. How exactly you do this depends on your version of OS X. Once you've done that, you should be able to call rhubarb
.
from rhubarb-lip-sync.
Oh, that makes sense. Thanks! This works really well - and really speeds up lip-syncing in OpenToonz!
from rhubarb-lip-sync.
Related Issues (20)
- Question: can it run at real time? HOT 2
- " is not a valid Shape value HOT 6
- [FEATURE REWUEST] Live printing of visemes HOT 1
- Rhubarb for Spine "Error performing speech recognition via PocketSphinx tools. Error creating speech decoder." HOT 2
- Script stucks After effects MacOS
- Feature Request - Support for OpenAI Whisper speech recognition model
- Error message saying "Check executable path in addon preferences" HOT 1
- Error performing speech recognition via PocketSphinx tools. HOT 4
- [Fatal] Application terminating with error: Error processing file audio.wav. HOT 1
- How to integrate this library in react or nodejs? HOT 4
- Can you direct me to where the source code is... HOT 10
- Real time animation for tts output HOT 1
- Build Rhubarb as shared library
- Rhubarb - Lip - Sync for 4.0 and above?? HOT 1
- Rhubarb crashes out of memory HOT 2
- Rhubarb crashes on MacOs x86_64
- Rhubarb for adobe animate? HOT 1
- Rhubarb-Lip-Sync can't work in linux HOT 1
- Installing on MacOS 14 Sonoma After Effects
- can I use it to put together an animation command line? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rhubarb-lip-sync.