Home
Softono
Comfyui-ChatTTS

Comfyui-ChatTTS

Open source MIT Python
87
Stars
6
Forks
14
Issues
1
Watchers
1 year
Last Commit

About Comfyui-ChatTTS

Comfyui-ChatTTS is a custom node package for ComfyUI that integrates ChatTTS text-to-speech capabilities directly into visual workflows. It enables users to generate high-quality speech with support for unique features like custom voice creation, voice reuse, and multi-person dialogue generation ideal for podcasts and scripted skits. The package includes specialized nodes such as ChatTTS for core generation, Multi Person Podcast for orchestrating conversations, and CreateSpeakers to define distinct characters. Users can easily save and load speaker profiles compatible with the ChatTTSSpeaker model repository. Additional functionality is provided through Whisper integration for automatic subtitle generation and OpenVoiceClone for precise voice cloning and character voice control. The tool is designed to simplify TTS workflows by handling technical complexities like speed and laughter tags automatically, requiring users to input plain text only. Setup involves downloading the main model from HuggingFace and pla

Platforms

Web Self-hosted

Languages

Python

Links

Comfyui-ChatTTS

寻求帮助 Mixlab nodes discord

推荐:mixlab-nodes

目前可以创建音色,复用音色,支持多人对话模式的生成,寻求帮助可以加入discord,注意输入的text不需要加[speed_3][laugh_2]这种手动控制的标签。

案例 : 多人对话 x 脱口秀

alt text

alt text

节点:

ChatTTS

Multi Person Podcast

CreateSpeakers

SaveSpeaker 、LoadSpeaker : 方便保存和加载音色,支持 ChatTTS_Speaker/summary 的音色加载

Load Whisper Model、Whisper Transcribe:方便导出音频对应的字幕文件

OpenVoiceClone :方便迁移音色,更好地控制角色声音

alt text

模型:

下载后放到 models/chat_tts

https://huggingface.co/2Noise/ChatTTS

音色pt文件放到models/chat_tts_speaker

openvoice 模型放到models/open_voice

whisper模型放到models/whisper/large-v3

alt text

分支是一个课程的示例代码:以ChatTTS为例,为ComfyUI增加语音合成功能。一个自定义的节点需要完成: python 运行时(后端)- 后端python怎么写 GUI - 怎么修改节点界面

相关插件推荐

comfyui-liveportrait

Comfyui-ChatTTS

comfyui-sound-lab

comfyui-Image-reward

comfyui-ultralytics-yolo

comfyui-moondream