rogermiranda1000/twitchttsbot

A Twitch bot that reads point redemptions with a custom trained voice.

TwitchTTSBot

A Twitch bot that reads point redemptions with a custom trained voice.

Check the results on my TTS gist.

Run

Once you've done all the steps in dependencies you can run the bot.

To run the bot you'll have to first run (inside the tts conda environment) cd rvc-tts-webui && python3 app.py, and then (simultaneously) cd TwitchTTSBot && python3 bot.py. Check the README inside the services folder to auto-run those steps on every startup.

Dependencies

Anaconda

• Install anaconda and gcc
• Create the conda environment: conda create -n tts python=3.9, and then activate it with conda activate tts
• Install pyTorch (if you want to use GPU): conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.7 -c pytorch -c nvidia -y

RVC-based TTS

Install

• Get the repo: git clone https://github.com/litagin02/rvc-tts-webui.git && cd rvc-tts-webui
• Download the models: curl -L -O https://huggingface.co/lj1995/VoiceConversionWebUI/resolve/main/hubert_base.pt ; curl -L -O https://huggingface.co/lj1995/VoiceConversionWebUI/resolve/main/rmvpe.pt
• Install the dependencies: python3 -m pip install -r requirements.txt

If the install raises the error Failed building wheel for pyworld, run python3 -m pip install numpy pyworld --no-build-isolation

Get the model

• Train a RVC model
• Set the logs path (<RVC path>/logs) in the variable model_root, in app.py
• Copy the latest .pth file of the desired speaker from <RVC path>/weights into <RVC path>/logs/<speaker>

PythonTwitchBotFramework

Install

• Run python3 -m pip install PythonTwitchBotFramework==2.11.5
• For the bot dependencies, run python3 -m pip install pypeln==0.4.9

Creating the Twitch bot

• Create a Twitch account to be used as a bot
• Create a new app. Set a name, Loyalty Tool as category, and (if you don't want to use it) http://localhost as OAuth redirect
• In order to get the OAuth token have to enter the login link (while being logged in in the bot account), and allow it. To generate the login link download https://github.com/sharkbound/PythonTwitchBotFramework/blob/master/util/token_utils.py and run print(generate_irc_oauth('<app id>', 'http://localhost')). Once you allow it you'll be redirected to localhost; you'll have to copy the access_token GET param in the URL (that's the OAuth token).

Setting up the stream Twitch account

• While being logged in in the desired channel, allow the following link: https://id.twitch.tv/oauth2/authorize?response_type=token&client_id=<app id>&redirect_uri=http://localhost&scope=channel%3Aread%3Aredemptions. Once you allow it you'll be redirected to localhost; you'll have to copy the access_token GET param in the URL (that's the PubSub token).
• Add a custom text reward redeem

Config setup

The first time you run the script it will raise a token exception, and it will generate some config files.

You'll have to edit config.json:

• Remove all commands in command_whitelist; leave only "command_whitelist": []
• Set the desired channel in channels
• Set the bot name in nick and owner
• Set the desired secret key in a new entry: "secret": "admin". This will be needed for the audio player, as you'll have to enter to localhost:7890?token=<secret>
• Set the desired redeem name in a new entry: "redeem": "Custom TTS"
• Set the app id in client_id
• Set the OAuth token in "oauth": "oauth:<token>"
• Set the PubSub token in a new entry: "pubsub": "<token>"
• Set the RVC-based TTS model name in a new entry; you can also set for each model the Pitch shift in an pitch-shift entry:

"voices": {
    "<model name>": {
        "name": "<model name>",
        "voice": "en-US-AriaNeural-Female"
    }
}

Optional additional properties:

• You can add a character limit by setting "input_limit": 450
• You can add a segments limit by setting "segments_limit": 12. Note: one segment is one change of model, or a sound being played.
• To add sounds to be replaced you'll have to add an audios folder and place there the .wav; then create a new audios entry with each audio and :

"audios": {
    "[bruh]": { "files": [ "bruh.wav" ] },
    "[brah]": { "alias": "[bruh]" }
}

Website audio player

Install

• Run python3 -m pip install Flask-SocketIO==4.3.1 python-engineio==3.13.2 python-socketio==4.6.0

Generating the SSL credentials

Inside the TwitchTTSBot/ folder, run openssl req -new -x509 -keyout key.pem -out server.pem -days 365 -nodes.

You can also get a secure SSL credentials pointing to an existant domain by following the steps shown in certbot instructions. Note: you'll have to open the port 80 before running the command.

twitchttsbot's Issues

Default commands not being disabled

The default commands are not being disabled. According to the library author this could be done with:

class DisableAllComamndsMod(Mod):
    async def loaded(self):
        for command in commands:
            disable_command('userman2', command)
            print(f'disabled command "{command}"')