feat: integrate ComfyUI_DiffRhythm extension with 7 models and 4 workflows
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 15s

- Add DiffRhythm to arty.yml references and setup/comfyui-nodes
- Install espeak-ng system dependency for phoneme processing
- Add 7 DiffRhythm models to models_huggingface.yaml with file mappings:
  * ASLP-lab/DiffRhythm-1_2 (95s generation)
  * ASLP-lab/DiffRhythm-full (4m45s generation)
  * ASLP-lab/DiffRhythm-base
  * ASLP-lab/DiffRhythm-vae
  * OpenMuQ/MuQ-MuLan-large
  * OpenMuQ/MuQ-large-msd-iter
  * FacebookAI/xlm-roberta-base
- Create 4 comprehensive workflows:
  * diffrhythm-simple-t2m-v1.json (basic 95s text-to-music)
  * diffrhythm-full-length-t2m-v1.json (4m45s full-length)
  * diffrhythm-reference-based-v1.json (style transfer with reference audio)
  * diffrhythm-random-generation-v1.json (no-prompt random generation)
- Update storage requirements: 90GB essential, 149GB total

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
2025-11-24 09:50:45 +01:00
parent 9439185b3d
commit f2186db78e
6 changed files with 646 additions and 7 deletions

View File

@@ -63,6 +63,11 @@ references:
description: "MusicGen and Stable Audio integration"
essential: false
- url: https://github.com/billwuhao/ComfyUI_DiffRhythm.git
into: $COMFYUI_ROOT/custom_nodes/ComfyUI_DiffRhythm
description: "DiffRhythm - Full-length song generation (up to 4m45s) with text/audio conditioning"
essential: false
- url: https://github.com/ssitu/ComfyUI_UltimateSDUpscale.git
into: $COMFYUI_ROOT/custom_nodes/ComfyUI_UltimateSDUpscale
description: "Ultimate SD Upscale for high-quality image upscaling"
@@ -279,43 +284,67 @@ scripts:
echo "========================================="
echo ""
# Install system dependencies
echo "Installing system dependencies..."
sudo apt-get update -qq
sudo apt-get install -y -qq espeak-ng
echo "✓ System dependencies installed (espeak-ng)"
echo ""
cd $COMFYUI_ROOT/custom_nodes
# ComfyUI Manager
echo "[1/5] Installing ComfyUI-Manager..."
echo "[1/6] Installing ComfyUI-Manager..."
if [ ! -d "ComfyUI-Manager" ]; then
git clone https://github.com/ltdrdata/ComfyUI-Manager.git
fi
[ -f "ComfyUI-Manager/requirements.txt" ] && sudo pip3 install -r ComfyUI-Manager/requirements.txt
# VideoHelperSuite
echo "[2/5] Installing ComfyUI-VideoHelperSuite..."
echo "[2/6] Installing ComfyUI-VideoHelperSuite..."
if [ ! -d "ComfyUI-VideoHelperSuite" ]; then
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git
fi
[ -f "ComfyUI-VideoHelperSuite/requirements.txt" ] && sudo pip3 install -r ComfyUI-VideoHelperSuite/requirements.txt
# AnimateDiff-Evolved
echo "[3/5] Installing ComfyUI-AnimateDiff-Evolved..."
echo "[3/6] Installing ComfyUI-AnimateDiff-Evolved..."
if [ ! -d "ComfyUI-AnimateDiff-Evolved" ]; then
git clone https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved.git
fi
[ -f "ComfyUI-AnimateDiff-Evolved/requirements.txt" ] && sudo pip3 install -r ComfyUI-AnimateDiff-Evolved/requirements.txt
# IPAdapter Plus
echo "[4/5] Installing ComfyUI_IPAdapter_plus..."
echo "[4/6] Installing ComfyUI_IPAdapter_plus..."
if [ ! -d "ComfyUI_IPAdapter_plus" ]; then
git clone https://github.com/cubiq/ComfyUI_IPAdapter_plus.git
fi
[ -f "ComfyUI_IPAdapter_plus/requirements.txt" ] && sudo pip3 install -r ComfyUI_IPAdapter_plus/requirements.txt
# Impact-Pack
echo "[5/5] Installing ComfyUI-Impact-Pack..."
echo "[5/6] Installing ComfyUI-Impact-Pack..."
if [ ! -d "ComfyUI-Impact-Pack" ]; then
git clone https://github.com/ltdrdata/ComfyUI-Impact-Pack.git
fi
[ -f "ComfyUI-Impact-Pack/requirements.txt" ] && sudo pip3 install -r ComfyUI-Impact-Pack/requirements.txt
# DiffRhythm
echo "[6/6] Installing ComfyUI_DiffRhythm..."
if [ ! -d "ComfyUI_DiffRhythm" ]; then
git clone https://github.com/billwuhao/ComfyUI_DiffRhythm.git
fi
if [ -f "ComfyUI_DiffRhythm/requirements.txt" ]; then
cd $COMFYUI_ROOT
source venv/bin/activate
pip install -r custom_nodes/ComfyUI_DiffRhythm/requirements.txt
deactivate
cd custom_nodes
fi
# Create DiffRhythm model directories
echo "Creating DiffRhythm model directories..."
mkdir -p $COMFYUI_ROOT/models/TTS/DiffRhythm/{MuQ-large-msd-iter,MuQ-MuLan-large,xlm-roberta-base}
# Fix numpy version for vLLM compatibility
echo "Fixing numpy version..."
sudo pip3 install 'numpy<2.0.0' --force-reinstall
@@ -327,6 +356,7 @@ scripts:
echo " - AnimateDiff-Evolved: Video generation"
echo " - IPAdapter_plus: Style transfer"
echo " - Impact-Pack: Face enhancement"
echo " - DiffRhythm: Full-length song generation"
setup/comfyui-extensions-deps: |
echo "========================================="