feat: integrate ComfyUI_DiffRhythm extension with 7 models and 4 workflows
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 15s
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 15s
- Add DiffRhythm to arty.yml references and setup/comfyui-nodes - Install espeak-ng system dependency for phoneme processing - Add 7 DiffRhythm models to models_huggingface.yaml with file mappings: * ASLP-lab/DiffRhythm-1_2 (95s generation) * ASLP-lab/DiffRhythm-full (4m45s generation) * ASLP-lab/DiffRhythm-base * ASLP-lab/DiffRhythm-vae * OpenMuQ/MuQ-MuLan-large * OpenMuQ/MuQ-large-msd-iter * FacebookAI/xlm-roberta-base - Create 4 comprehensive workflows: * diffrhythm-simple-t2m-v1.json (basic 95s text-to-music) * diffrhythm-full-length-t2m-v1.json (4m45s full-length) * diffrhythm-reference-based-v1.json (style transfer with reference audio) * diffrhythm-random-generation-v1.json (no-prompt random generation) - Update storage requirements: 90GB essential, 149GB total 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
40
arty.yml
40
arty.yml
@@ -63,6 +63,11 @@ references:
|
||||
description: "MusicGen and Stable Audio integration"
|
||||
essential: false
|
||||
|
||||
- url: https://github.com/billwuhao/ComfyUI_DiffRhythm.git
|
||||
into: $COMFYUI_ROOT/custom_nodes/ComfyUI_DiffRhythm
|
||||
description: "DiffRhythm - Full-length song generation (up to 4m45s) with text/audio conditioning"
|
||||
essential: false
|
||||
|
||||
- url: https://github.com/ssitu/ComfyUI_UltimateSDUpscale.git
|
||||
into: $COMFYUI_ROOT/custom_nodes/ComfyUI_UltimateSDUpscale
|
||||
description: "Ultimate SD Upscale for high-quality image upscaling"
|
||||
@@ -279,43 +284,67 @@ scripts:
|
||||
echo "========================================="
|
||||
echo ""
|
||||
|
||||
# Install system dependencies
|
||||
echo "Installing system dependencies..."
|
||||
sudo apt-get update -qq
|
||||
sudo apt-get install -y -qq espeak-ng
|
||||
echo "✓ System dependencies installed (espeak-ng)"
|
||||
echo ""
|
||||
|
||||
cd $COMFYUI_ROOT/custom_nodes
|
||||
|
||||
# ComfyUI Manager
|
||||
echo "[1/5] Installing ComfyUI-Manager..."
|
||||
echo "[1/6] Installing ComfyUI-Manager..."
|
||||
if [ ! -d "ComfyUI-Manager" ]; then
|
||||
git clone https://github.com/ltdrdata/ComfyUI-Manager.git
|
||||
fi
|
||||
[ -f "ComfyUI-Manager/requirements.txt" ] && sudo pip3 install -r ComfyUI-Manager/requirements.txt
|
||||
|
||||
# VideoHelperSuite
|
||||
echo "[2/5] Installing ComfyUI-VideoHelperSuite..."
|
||||
echo "[2/6] Installing ComfyUI-VideoHelperSuite..."
|
||||
if [ ! -d "ComfyUI-VideoHelperSuite" ]; then
|
||||
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git
|
||||
fi
|
||||
[ -f "ComfyUI-VideoHelperSuite/requirements.txt" ] && sudo pip3 install -r ComfyUI-VideoHelperSuite/requirements.txt
|
||||
|
||||
# AnimateDiff-Evolved
|
||||
echo "[3/5] Installing ComfyUI-AnimateDiff-Evolved..."
|
||||
echo "[3/6] Installing ComfyUI-AnimateDiff-Evolved..."
|
||||
if [ ! -d "ComfyUI-AnimateDiff-Evolved" ]; then
|
||||
git clone https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved.git
|
||||
fi
|
||||
[ -f "ComfyUI-AnimateDiff-Evolved/requirements.txt" ] && sudo pip3 install -r ComfyUI-AnimateDiff-Evolved/requirements.txt
|
||||
|
||||
# IPAdapter Plus
|
||||
echo "[4/5] Installing ComfyUI_IPAdapter_plus..."
|
||||
echo "[4/6] Installing ComfyUI_IPAdapter_plus..."
|
||||
if [ ! -d "ComfyUI_IPAdapter_plus" ]; then
|
||||
git clone https://github.com/cubiq/ComfyUI_IPAdapter_plus.git
|
||||
fi
|
||||
[ -f "ComfyUI_IPAdapter_plus/requirements.txt" ] && sudo pip3 install -r ComfyUI_IPAdapter_plus/requirements.txt
|
||||
|
||||
# Impact-Pack
|
||||
echo "[5/5] Installing ComfyUI-Impact-Pack..."
|
||||
echo "[5/6] Installing ComfyUI-Impact-Pack..."
|
||||
if [ ! -d "ComfyUI-Impact-Pack" ]; then
|
||||
git clone https://github.com/ltdrdata/ComfyUI-Impact-Pack.git
|
||||
fi
|
||||
[ -f "ComfyUI-Impact-Pack/requirements.txt" ] && sudo pip3 install -r ComfyUI-Impact-Pack/requirements.txt
|
||||
|
||||
# DiffRhythm
|
||||
echo "[6/6] Installing ComfyUI_DiffRhythm..."
|
||||
if [ ! -d "ComfyUI_DiffRhythm" ]; then
|
||||
git clone https://github.com/billwuhao/ComfyUI_DiffRhythm.git
|
||||
fi
|
||||
if [ -f "ComfyUI_DiffRhythm/requirements.txt" ]; then
|
||||
cd $COMFYUI_ROOT
|
||||
source venv/bin/activate
|
||||
pip install -r custom_nodes/ComfyUI_DiffRhythm/requirements.txt
|
||||
deactivate
|
||||
cd custom_nodes
|
||||
fi
|
||||
|
||||
# Create DiffRhythm model directories
|
||||
echo "Creating DiffRhythm model directories..."
|
||||
mkdir -p $COMFYUI_ROOT/models/TTS/DiffRhythm/{MuQ-large-msd-iter,MuQ-MuLan-large,xlm-roberta-base}
|
||||
|
||||
# Fix numpy version for vLLM compatibility
|
||||
echo "Fixing numpy version..."
|
||||
sudo pip3 install 'numpy<2.0.0' --force-reinstall
|
||||
@@ -327,6 +356,7 @@ scripts:
|
||||
echo " - AnimateDiff-Evolved: Video generation"
|
||||
echo " - IPAdapter_plus: Style transfer"
|
||||
echo " - Impact-Pack: Face enhancement"
|
||||
echo " - DiffRhythm: Full-length song generation"
|
||||
|
||||
setup/comfyui-extensions-deps: |
|
||||
echo "========================================="
|
||||
|
||||
Reference in New Issue
Block a user