jimmyken/chatglm2-voice-cloning

Chat with any character you like: ChatGLM2+SadTalker+Voice Cloning | 和喜欢的角色沉浸式对话吧：ChatGLM2+声音克隆+视频对话

ChatGLM2+Voice Cloning+SadTalker 🎶

Chat with any character you like immersively through ChatGLM2-6B, FreeVC and SadTalker in real time 📺💕🍻

简体中文

Easy to use 💡

(1) Run

git clone https://github.com/KevinWang676/ChatGLM2-Voice-Cloning.git
cd ChatGLM2-Voice-Cloning
pip install -r requirements.txt

(2) Run

sudo apt update && sudo apt upgrade
apt install ffmpeg

(3) Upload freevc-24.pth to the folder ./ChatGLM2-Voice-Cloning/checkpoint/. You can download freevc-24.pth through this link.

(4) Upload pretrained_bak_5805000.pt to the folder ./ChatGLM2-Voice-Cloning/speaker_encoder/ckpt/. You can download pretrained_bak_5805000.pt through this link.

(5) Run python app_en.py.

(6) Done! Now you can open Gradio interface and chat with any character you like through ChatGLM2-6B and voice cloning. 💕

P.S. The code is based on ChatGLM2-6B, FreeVC, and SadTalker.

Quick start: HuggingFace Demo 🤗

If you like the my application, please star this repository. ⭐⭐⭐

Gradio Interface: