fix: update DiffRhythm workflows with correct node names and parameters
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 14s
Updated all 4 DiffRhythm workflow JSON files to use actual node class names from ComfyUI_DiffRhythm: **Node Name Changes:** - DiffRhythmTextToMusic → DiffRhythmRun - DiffRhythmRandomGeneration → DiffRhythmRun (with empty style_prompt) - DiffRhythmReferenceBasedGeneration → DiffRhythmRun (with audio input) **Corrected Parameter Structure:** All workflows now use proper widgets_values array matching DiffRhythmRun INPUT_TYPES: 1. model (string: "cfm_model_v1_2.pt", "cfm_model.pt", or "cfm_full_model.pt") 2. style_prompt (string: multiline text or empty for random) 3. unload_model (boolean: default true) 4. odeint_method (string: "euler", "midpoint", "rk4", "implicit_adams") 5. steps (int: 1-100, default 30) 6. cfg (int: 1-10, default 4) 7. quality_or_speed (string: "quality" or "speed") 8. seed (int: -1 for random, or specific number) 9. edit (boolean: default false) 10. edit_segments (string: "[-1, 20], [60, -1]") **Workflow-Specific Updates:** **diffrhythm-simple-t2m-v1.json:** - Text-to-music workflow for 95s generation - Uses cfm_model_v1_2.pt with text prompt guidance - Default settings: steps=30, cfg=4, speed mode, seed=42 **diffrhythm-full-length-t2m-v1.json:** - Full-length 4m45s (285s) generation - Uses cfm_full_model.pt for extended compositions - Quality mode enabled for better results - Default seed=123 **diffrhythm-reference-based-v1.json:** - Reference audio + text prompt workflow - Uses LoadAudio node connected to style_audio_or_edit_song input - Higher cfg=5 for stronger prompt adherence - Demonstrates optional audio input connection **diffrhythm-random-generation-v1.json:** - Pure random generation (no prompt/guidance) - Empty style_prompt string - Minimal cfg=1 for maximum randomness - Random seed=-1 for unique output each time **Documentation Updates:** - Removed PLACEHOLDER notes - Updated usage sections with correct parameter descriptions - Added notes about optional MultiLineLyricsDR node for lyrics - Clarified parameter behavior and recommendations These workflows are now ready to use in ComfyUI with the installed DiffRhythm extension. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -4,9 +4,9 @@
|
||||
"nodes": [
|
||||
{
|
||||
"id": 1,
|
||||
"type": "DiffRhythmRandomGeneration",
|
||||
"type": "DiffRhythmRun",
|
||||
"pos": [100, 100],
|
||||
"size": [400, 250],
|
||||
"size": [400, 400],
|
||||
"flags": {},
|
||||
"order": 0,
|
||||
"mode": 0,
|
||||
@@ -14,15 +14,23 @@
|
||||
{
|
||||
"name": "AUDIO",
|
||||
"type": "AUDIO",
|
||||
"links": [1]
|
||||
"links": [1, 2]
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "DiffRhythmRun"
|
||||
},
|
||||
"widgets_values": [
|
||||
95.0,
|
||||
"cfm_model_v1_2.pt",
|
||||
"",
|
||||
true,
|
||||
"euler",
|
||||
30,
|
||||
1,
|
||||
"speed",
|
||||
-1,
|
||||
"cfm_model_v1_2",
|
||||
"auto"
|
||||
false,
|
||||
"[-1, 20], [60, -1]"
|
||||
],
|
||||
"title": "DiffRhythm Random Generation (No Prompt)"
|
||||
},
|
||||
@@ -41,7 +49,9 @@
|
||||
"link": 1
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "PreviewAudio"
|
||||
},
|
||||
"title": "Preview Audio"
|
||||
},
|
||||
{
|
||||
@@ -59,7 +69,9 @@
|
||||
"link": 2
|
||||
}
|
||||
],
|
||||
"properties": {},
|
||||
"properties": {
|
||||
"Node name for S&R": "SaveAudio"
|
||||
},
|
||||
"widgets_values": [
|
||||
"diffrhythm_random_output"
|
||||
],
|
||||
@@ -88,10 +100,15 @@
|
||||
"system_deps": ["espeak-ng"]
|
||||
},
|
||||
"usage": {
|
||||
"duration": "Fixed at 95 seconds for DiffRhythm 1.2 model",
|
||||
"seed": "-1 (random seed each generation) or specific number for reproducibility",
|
||||
"model": "cfm_model_v1_2 (DiffRhythm 1.2)",
|
||||
"device": "auto (automatic GPU selection)",
|
||||
"model": "cfm_model_v1_2.pt (DiffRhythm 1.2 - 95s generation)",
|
||||
"style_prompt": "Empty string for random generation (no guidance)",
|
||||
"unload_model": "Boolean to unload model after generation (default: true)",
|
||||
"odeint_method": "ODE solver: euler (default)",
|
||||
"steps": "Number of diffusion steps: 30 (default)",
|
||||
"cfg": "Classifier-free guidance: 1 (minimal guidance for random output)",
|
||||
"quality_or_speed": "Generation mode: speed (default)",
|
||||
"seed": "-1 for random seed each generation, or specific number for reproducibility",
|
||||
"edit": "false (no editing)",
|
||||
"note": "NO prompt, NO guidance, NO reference audio - pure random generation"
|
||||
},
|
||||
"use_cases": [
|
||||
@@ -106,16 +123,18 @@
|
||||
"Use seed=-1 for completely random output each time",
|
||||
"Use fixed seed to reproduce interesting random results",
|
||||
"Batch process: Run 10-20 times to find interesting compositions",
|
||||
"Save any interesting results with their seed numbers"
|
||||
"Save any interesting results with their seed numbers",
|
||||
"Empty style_prompt with cfg=1 produces truly random output"
|
||||
],
|
||||
"notes": [
|
||||
"This workflow demonstrates DiffRhythm's ability to generate music without any input",
|
||||
"All DiffRhythm parameters are optional - this is the ultimate proof",
|
||||
"All DiffRhythm parameters except model are at their most permissive settings",
|
||||
"Empty string for style_prompt means no guidance from text",
|
||||
"cfg=1 provides minimal guidance, maximizing randomness",
|
||||
"Results can range from ambient to energetic, classical to electronic",
|
||||
"Each generation is unique (with seed=-1)",
|
||||
"Generation time: ~30-60 seconds on RTX 4090",
|
||||
"Perfect for discovering unexpected musical combinations",
|
||||
"PLACEHOLDER: Actual node names and parameters need to be updated after ComfyUI_DiffRhythm installation"
|
||||
"Perfect for discovering unexpected musical combinations"
|
||||
]
|
||||
}
|
||||
},
|
||||
|
||||
Reference in New Issue
Block a user