fix: update DiffRhythm workflows with correct node names and parameters
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
Updated all 4 DiffRhythm workflow JSON files to use actual node class names from ComfyUI_DiffRhythm: **Node Name Changes:** - DiffRhythmTextToMusic → DiffRhythmRun - DiffRhythmRandomGeneration → DiffRhythmRun (with empty style_prompt) - DiffRhythmReferenceBasedGeneration → DiffRhythmRun (with audio input) **Corrected Parameter Structure:** All workflows now use proper widgets_values array matching DiffRhythmRun INPUT_TYPES: 1. model (string: "cfm_model_v1_2.pt", "cfm_model.pt", or "cfm_full_model.pt") 2. style_prompt (string: multiline text or empty for random) 3. unload_model (boolean: default true) 4. odeint_method (string: "euler", "midpoint", "rk4", "implicit_adams") 5. steps (int: 1-100, default 30) 6. cfg (int: 1-10, default 4) 7. quality_or_speed (string: "quality" or "speed") 8. seed (int: -1 for random, or specific number) 9. edit (boolean: default false) 10. edit_segments (string: "[-1, 20], [60, -1]") **Workflow-Specific Updates:** **diffrhythm-simple-t2m-v1.json:** - Text-to-music workflow for 95s generation - Uses cfm_model_v1_2.pt with text prompt guidance - Default settings: steps=30, cfg=4, speed mode, seed=42 **diffrhythm-full-length-t2m-v1.json:** - Full-length 4m45s (285s) generation - Uses cfm_full_model.pt for extended compositions - Quality mode enabled for better results - Default seed=123 **diffrhythm-reference-based-v1.json:** - Reference audio + text prompt workflow - Uses LoadAudio node connected to style_audio_or_edit_song input - Higher cfg=5 for stronger prompt adherence - Demonstrates optional audio input connection **diffrhythm-random-generation-v1.json:** - Pure random generation (no prompt/guidance) - Empty style_prompt string - Minimal cfg=1 for maximum randomness - Random seed=-1 for unique output each time **Documentation Updates:** - Removed PLACEHOLDER notes - Updated usage sections with correct parameter descriptions - Added notes about optional MultiLineLyricsDR node for lyrics - Clarified parameter behavior and recommendations These workflows are now ready to use in ComfyUI with the installed DiffRhythm extension. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -4,9 +4,9 @@
|
||||
"nodes": [
|
||||
{
|
||||
"id": 1,
|
||||
"type": "DiffRhythmTextToMusic",
|
||||
"type": "DiffRhythmRun",
|
||||
"pos": [100, 100],
|
||||
"size": [400, 300],
|
||||
"size": [400, 400],
|
||||
"flags": {},
|
||||
"order": 0,
|
||||
"mode": 0,
|
||||
@@ -14,17 +14,23 @@
|
||||
{
|
||||
"name": "AUDIO",
|
||||
"type": "AUDIO",
|
||||
"links": [1]
|
||||
"links": [1, 2]
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "DiffRhythmRun"
|
||||
},
|
||||
"widgets_values": [
|
||||
"cfm_model_v1_2.pt",
|
||||
"Upbeat electronic dance music with energetic beats and synthesizer melodies",
|
||||
95.0,
|
||||
4.0,
|
||||
true,
|
||||
"euler",
|
||||
30,
|
||||
4,
|
||||
"speed",
|
||||
42,
|
||||
"cfm_model_v1_2",
|
||||
"auto"
|
||||
false,
|
||||
"[-1, 20], [60, -1]"
|
||||
],
|
||||
"title": "DiffRhythm Text-to-Music (95s)"
|
||||
},
|
||||
@@ -43,7 +49,9 @@
|
||||
"link": 1
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "PreviewAudio"
|
||||
},
|
||||
"title": "Preview Audio"
|
||||
},
|
||||
{
|
||||
@@ -61,7 +69,9 @@
|
||||
"link": 2
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "SaveAudio"
|
||||
},
|
||||
"widgets_values": [
|
||||
"diffrhythm_output"
|
||||
],
|
||||
@@ -90,19 +100,23 @@
|
||||
"system_deps": ["espeak-ng"]
|
||||
},
|
||||
"usage": {
|
||||
"prompt": "Text description of the desired music style, mood, and instruments",
|
||||
"duration": "Fixed at 95 seconds for DiffRhythm 1.2 model",
|
||||
"guidance_scale": "Controls how closely the output follows the prompt (1.0-10.0, default: 4.0)",
|
||||
"model": "cfm_model_v1_2.pt (DiffRhythm 1.2 - 95s generation)",
|
||||
"style_prompt": "Text description of the desired music style, mood, and instruments",
|
||||
"unload_model": "Boolean to unload model after generation (default: true)",
|
||||
"odeint_method": "ODE solver: euler, midpoint, rk4, implicit_adams (default: euler)",
|
||||
"steps": "Number of diffusion steps: 1-100 (default: 30)",
|
||||
"cfg": "Classifier-free guidance scale: 1-10 (default: 4)",
|
||||
"quality_or_speed": "Generation mode: quality or speed (default: speed)",
|
||||
"seed": "Random seed for reproducibility (default: 42)",
|
||||
"model": "cfm_model_v1_2 (DiffRhythm 1.2 - 95s generation)",
|
||||
"device": "auto (automatic GPU selection)"
|
||||
"edit": "Enable segment editing mode (default: false)",
|
||||
"edit_segments": "Segments to edit when edit=true (default: [-1, 20], [60, -1])"
|
||||
},
|
||||
"notes": [
|
||||
"This workflow uses DiffRhythm 1.2 for 95-second music generation",
|
||||
"All parameters are optional - can generate music randomly without inputs",
|
||||
"All parameters except model and style_prompt are optional",
|
||||
"Supports English and Chinese text prompts",
|
||||
"Generation time: ~30-60 seconds on RTX 4090",
|
||||
"PLACEHOLDER: Actual node names and parameters need to be updated after ComfyUI_DiffRhythm installation"
|
||||
"Can optionally connect MultiLineLyricsDR node for lyrics input"
|
||||
]
|
||||
}
|
||||
},
|
||||
|
||||
Reference in New Issue
Block a user