Welcome to the ComfyUI-Mana-Nodes project!
This collection of custom nodes is designed to supercharge text-based content creation within the ComfyUI environment.
Whether you're working on dynamic captions, transcribing audio, or crafting engaging visual content, Mana Nodes has got you covered.
If you like Mana Nodes, give our repo a β Star and π Watch our repository to stay updated.
You can install Mana Nodes via the ComfyUI-Manager
Or simply clone the repo into the custom_nodes directory with this command:
git clone https://github.com/ForeignGods/ComfyUI-Mana-Nodes.git
and install the requirements using:
.\python_embed\python.exe -s -m pip install -r requirements.txt --user
If you are using a venv, make sure you have it activated before installation and use:
pip install -r requirements.txt
βοΈ Text to Image Generator
To set the font and its styling you need to input π Font Properties node here.
To configure the canvas input the πΌοΈ Canvas Properties
Specifies the text to be rendered on the images. Supports multiline text input for rendering on separate lines.
- For simple text: Input the text directly as a string.
- For frame-specific text: Use a JSON-like format where each line specifies a frame number and the corresponding text. Example:
"1": "Hello", "10": "World", "20": "End"
Sets the amount of frames this node will output.
Input the transcription output from the π€ Speech Recognition node here. Based on this transcription data, πΌοΈ Canvas Properties and π Font Properties the text should be formatted in a way that builds up lines of words until there is no space on the canvas left (transcription_mode: fill, line).
Input a secondary font π Font Properties, that is used to highlight the active caption (transcription_mode: fill, line). When manually setting the text the following syntax can be used to defined which word/character:
Hello <tag>World</tag>
The generated images with the specified text and configurations, in common ComfyUI format (compatible with other nodes).
Framestamps formatted based on canvas, font and transcription settings. Can be useful to manually correct errors by π€ Speech Recognition node. Example: Save this output with π Save/Preview Text -> manually correct mistakes -> remove transcription input from βοΈ Text to Image Generator node -> paste corrected framestamps into text input field of βοΈ Text to Image Generator node.
π Font Properties
Fonts located in the custom_nodes\ComfyUI-Mana-Nodes\font_files\example_font.ttf or system font directories (supports .ttf, .otf, .woff, .woff2).
Either set single value font_size or input animation definition via the β° Scheduled Values node. (Convert font_size to input)
Either set single color value (CSS3/Color/Extended color keywords) or input animation definition via the π Preset Color Animations node. (Convert font_color to input)
Either set single horiontal and vertical offset value or input animation definition via the β° Scheduled Values node. (Convert x_offset/y_offset to input)
Either set single rotation value or input animation definition via the β° Scheduled Values node. (Convert rotation to input)
Horizontal and vertical offsets of the rotation anchor point, relative to the texts initial position.
Spacing between characters of font.
Width of the text border.
Either set single color value (CSS3/Color/Extended color keywords) or input animation definition via the π Preset Color Animations node. (Convert border_color to input)
Either set single color value (CSS3/Color/Extended color keywords) or input animation definition via the π Preset Color Animations node. (Convert shadow_color to input)
Horizontal and vertical offset of the text shadow.
Used as input on βοΈ Text to Image Generator node for the font and highlight_font.
πΌοΈ Canvas Properties
Dimensions of the canvas.
Background color of the canvas. (CSS3/Color/Extended color keywords)
Padding between image border and font.
Spacing between lines of text on the canvas.
Can be used to input images instead of using background_color.
Used as input on βοΈ Text to Image Generator node to define the canvas settings.
β° Scheduled Values
Sets the range of the x axis of the chart. (always starts at 1)
Sets the range of the y axis of the chart. (Example: 25, will would be ranging from -25 to 25) This can be changed by zooming via the mousewheel and will reset to the specified value if changed.
Is used to generate values in between of the manually added values by the user by clicking the Generate Values button.
The available easing functions are:
- linear
- easeInQuad
- easeOutQuad
- easeInOutQuad
- easeInCubic
- easeOutCubic
- easeInOutCubic
- easeInQuart
- easeOutQuart
- easeInOutQuart
- easeInQuint
- easeOutQuint
- easeInOutQuint
- exponential
The option single will force the chart to display every single tick/step on the chart. The option auto will automatically remove ticks/step to prevent overlapping.
Used to specify the reset behaviour of the animation.
- word: animation will be reset when a new word is displayed, stays on last value when animation finished before word change.
- line: animation will be reset when a new line is displayed, stays on last value when animation finished before line change.
- never: animation will just run once and stop on last value. (Not affected by word or line change)
- looped: animation will endlessly loop. (Not affected by word or line change)
- pingpong: animation will first play forward then back and so on. (Not affected by word or line change)
Adding Values: Click on the chart to add keyframes at specific points. Editing Values: Double-click on a keyframe to edit its frame and value. Deleting Values: Click on the delete button associated with each keyframe to remove it. Generating Values: Click on the "Generate Values" button to interpolate values between existing keyframes. Deleting Generated Values: Click on the "Delete Generated" button to remove all interpolated values.
Outputs a list of frame and value pairs and the animation_reset option. At the moment this output can be used to animate the following widgets (Convert property to input) of the π Font Properties node:
- font_size (font, higlight_font)
- x_offset (font)
- y_offset (font)
- rotation (font)
π Preset Color Animations
Currently the following color animation presets are available:
- rainbow
- sunset
- grey
- ocean
- forest
- fire
- sky
- earth
Sets the length of the animation measured as frames.
Used to specify the reset behaviour of the animation.
- word: animation will be reset when a new word is displayed, stays on last value when animation finished before word change.
- line: animation will be reset when a new line is displayed, stays on last value when animation finished before line change.
- never: animation will just run once and stop on last value. (Not affected by word or line change)
- looped: animation will endlessly loop. (Not affected by word or line change)
- pingpong: animation will first play forward then back and so on. (Not affected by word or line change)
Outputs a list of frame and color definitions and the animation_reset option. At the moment this output can be used to animate the following widgets (Convert property to input) of the π Font Properties node:
- font_color (font, higlight_font)
- border_color (font, higlight_font)
- shadow_color (font, higlight_font)
π€ Speech Recognition
Converts spoken words in an audio file to text using a deep learning model.
Audio file path or URL.
The Wav2Vec2 model used for speech recognition. (https://huggingface.co/models?search=wav2vec2)
Language for the spell checker.
Maximum characters allowed until new framestamp line is created.
Frames per second, used for synchronizing with video. (Default set to 30)
Text transcription of the audio. (Should only be used as font2img transcription input)
Raw string of the transcription without timestamps.
Frame-stamped transcription.
Transcription with timestamps.
Returns the transcribed text as one line.
THE GREATEST TRICK THE DEVIL EVER PULLED WAS CONVINCING THE WORLD HE DIDN'T EXIST
Depending on the framestamps_max_chars parameter the sentece will be cleared and starts to build up again until max_chars is reached again.
- In this example framestamps_max_chars is set to 25.
"27": "THE",
"31": "THE GREATEST",
"43": "THE GREATEST TRICK",
"73": "THE GREATEST TRICK THE",
"77": "DEVIL",
"88": "DEVIL EVER",
"94": "DEVIL EVER PULLED",
"127": "DEVIL EVER PULLED WAS",
"133": "CONVINCING",
"150": "CONVINCING THE",
"154": "CONVINCING THE WORLD",
"167": "CONVINCING THE WORLD HE",
"171": "DIDN'T",
"178": "DIDN'T EXIST",
Returns all transcribed words, their start_time and end_time in json format as a string.
[
{
"word": "THE",
"start_time": 0.9,
"end_time": 0.98
},
{
"word": "GREATEST",
"start_time": 1.04,
"end_time": 1.36
},
{
"word": "TRICK",
"start_time": 1.44,
"end_time": 1.68
},
...
]
ποΈ Split Video
Path the video file.
Maximum number of frames to extract from the video.
Starting frame number for extraction.
Prefix for naming the extracted audio file. (relative to .\ComfyUI\output)
Extracted frames as image tensors.
Total number of frames extracted.
Path of the extracted audio file.
Frames per second of the video.
Dimensions of the extracted frames.
π₯ Combine Video
Sequence of images to be used as video frames.
Prefix for naming the video file. (relative to .\ComfyUI\output)
Frames per second for the video.
Audio file path or URL.
Path to the created video file.
π£ Generate Audio (experimental)
Converts text to speech and saves the output as an audio file.
The text to be converted into speech.
Prefix for naming the audio file. (relative to .\ComfyUI\output)
This node uses a text-to-speech pipeline to convert input text into spoken words, saving the result as a WAV file. The generated audio file is named using the provided filename prefix and is stored relative to the .\ComfyUI-Mana-Nodes directory.
Model: https://huggingface.co/spaces/suno/bark
Bark supports various languages out-of-the-box and automatically determines language from input text. When prompted with code-switched text, Bark will even attempt to employ the native accent for the respective languages in the same voice.
Example:
Buenos dΓas Miguel. Tu colega piensa que tu alemΓ‘n es extremadamente malo. But I suppose your english isn't terrible.
Below is a list of some known non-speech sounds, but we are finding more every day.
[laughter] [laughs] [sighs] [music] [gasps] [clears throat] β or β¦ for hesitations βͺ for song lyrics capitalization for emphasis of a word MAN/WOMAN: for bias towards speaker
Example:
" [clears throat] Hello, my name is Suno. And, uh β and I like pizza. [laughs] But I also have other interests such as... βͺ singing βͺ."
Bark can generate all types of audio, and, in principle, doesnβt see a difference between speech and music. Sometimes Bark chooses to generate text as music, but you can help it out by adding music notes around your lyrics.
Example:
βͺ In the jungle, the mighty jungle, the lion barks tonight βͺ
You can provide certain speaker prompts such as NARRATOR, MAN, WOMAN, etc. Please note that these are not always respected, especially if a conflicting audio history prompt is given.
Example:
WOMAN: I would like an oatmilk latte please. MAN: Wow, that's expensive!
π Save/Preview Text
The string to be written to the file.
Prefix for naming the text file. (relative to .\output)
| Demo 1 | Demo 2 | Demo 3 |
|---|---|---|
The values for the β° Scheduled Values node cannot be imported yet (you have to add them yourself).
Turn on audio.
video_552.mp4
- Improve Speech Recognition
- Improve Text to Speech
- Node to download fonts from DaFont.com
- SVG Loader/Animator
- Text to Image Generator Alpha Channel
- Add Font Support for non Latin Characters
- 3D Effects, Bevel/Emboss, Inner Shading, Fade in/out
- Find a better way to define color animations
- Make more Font Properties animatable
Your contributions to improve Mana Nodes are welcome!
If you have suggestions or enhancements, feel free to fork this repository, apply your changes, and create a pull request. For significant modifications or feature requests, please open an issue first to discuss what you'd like to change.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent