valknar/runpod
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
6efb55c59f604afbeb3d5a8724fbb761fbb18ffd
runpod/comfyui/workflows/image-to-video/i2v_wan22-14b-fun-control.json
Sebastian Krüger 6efb55c59f
All checks were successful
Build and Push RunPod Docker Image / build-and-push (push) Successful in 15s
Details
feat: add complete HunyuanVideo and Wan2.2 video generation integration 
Integrated 35+ video generation models and 13 production workflows from ComfyUI docs tutorials for state-of-the-art text-to-video and image-to-video generation.

Models Added (models_huggingface.yaml):
- HunyuanVideo (5 models): Original T2V/I2V (720p), v1.5 (720p/1080p) with Qwen 2.5 VL
- Wan2.2 diffusion models (18 models):
  - 5B TI2V hybrid (8GB VRAM, efficient)
  - 14B variants: T2V, I2V (high/low noise), Animate, S2V (FP8/BF16), Fun Camera/Control (high/low noise)
- Support models (12): VAEs, UMT5-XXL, CLIP Vision H, Wav2Vec2, LLaVA encoders
- LoRA accelerators (4): Lightx2v 4-step distillation for 5x speedup

Workflows Added (comfyui/workflows/image-to-video/):
- HunyuanVideo (5 workflows): T2V original, I2V v1/v2 (webp embedded), v1.5 T2V/I2V (JSON)
- Wan2.2 (8 workflows): 5B TI2V, 14B T2V/I2V/FLF2V/Animate/S2V/Fun Camera/Fun Control
- Asset files (10): Reference images, videos, audio for workflow testing

Custom Nodes Added (arty.yml):
- ComfyUI-KJNodes: Kijai optimizations for HunyuanVideo/Wan2.2 (FP8 scaling, video helpers)
- comfyui_controlnet_aux: ControlNet preprocessors (Canny, Depth, OpenPose, MLSD) for Fun Control
- ComfyUI-GGUF: GGUF quantization support for memory optimization

VRAM Requirements:
- HunyuanVideo original: 24GB (720p T2V/I2V, 129 frames, 5s generation)
- HunyuanVideo 1.5: 30-60GB (720p/1080p, improved quality with Qwen 2.5 VL)
- Wan2.2 5B: 8GB (efficient dual-expert architecture with native offloading)
- Wan2.2 14B: 24GB (high-quality video generation, all modes)

Note: Wan2.2 Fun Inpaint workflow not available in official templates repository (404).

Tutorial Sources:
- https://docs.comfy.org/tutorials/video/hunyuan/hunyuan-video
- https://docs.comfy.org/tutorials/video/hunyuan/hunyuan-video-1-5
- https://docs.comfy.org/tutorials/video/wan/wan2_2
- https://docs.comfy.org/tutorials/video/wan/wan2-2-animate
- https://docs.comfy.org/tutorials/video/wan/wan2-2-s2v
- https://docs.comfy.org/tutorials/video/wan/wan2-2-fun-camera
- https://docs.comfy.org/tutorials/video/wan/wan2-2-fun-control

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-25 10:43:39 +01:00

2908 lines
59 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
{
"id": "ec7da562-7e21-4dac-a0d2-f4441e1efd3b",
"revision": 0,
"last_node_id": 186,
"last_link_id": 326,
"nodes": [
{
"id": 100,
"type": "CreateVideo",
"pos": [
1700,
520
],
"size": [
270,
78
],
"flags": {},
"order": 41,
"mode": 0,
"inputs": [
{
"name": "images",
"type": "IMAGE",
"link": 179
},
{
"name": "audio",
"shape": 7,
"type": "AUDIO",
"link": null
}
],
"outputs": [
{
"name": "VIDEO",
"type": "VIDEO",
"links": [
177
]
}
],
"properties": {
"Node name for S&R": "CreateVideo",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
16
]
},
{
"id": 97,
"type": "VAEDecode",
"pos": [
1700,
420
],
"size": [
210,
46
],
"flags": {},
"order": 39,
"mode": 0,
"inputs": [
{
"name": "samples",
"type": "LATENT",
"link": 175
},
{
"name": "vae",
"type": "VAE",
"link": 176
}
],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"slot_index": 0,
"links": [
179
]
}
],
"properties": {
"Node name for S&R": "VAEDecode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 101,
"type": "UNETLoader",
"pos": [
120,
450
],
"size": [
320,
82
],
"flags": {},
"order": 0,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
244
]
}
],
"properties": {
"Node name for S&R": "UNETLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"directory": "diffusion_models"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"default"
]
},
{
"id": 102,
"type": "UNETLoader",
"pos": [
120,
580
],
"size": [
320,
90
],
"flags": {},
"order": 1,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
246
]
}
],
"properties": {
"Node name for S&R": "UNETLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"directory": "diffusion_models"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"default"
]
},
{
"id": 90,
"type": "CLIPLoader",
"pos": [
110,
730
],
"size": [
340,
110
],
"flags": {},
"order": 2,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "CLIP",
"type": "CLIP",
"slot_index": 0,
"links": [
164,
178
]
}
],
"properties": {
"Node name for S&R": "CLIPLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/resolve/main/split_files/text_encoders/umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"directory": "text_encoders"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"wan",
"default"
]
},
{
"id": 92,
"type": "VAELoader",
"pos": [
110,
900
],
"size": [
344.731689453125,
59.98149108886719
],
"flags": {},
"order": 3,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "VAE",
"type": "VAE",
"slot_index": 0,
"links": [
176,
287
]
}
],
"properties": {
"Node name for S&R": "VAELoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan_2.1_vae.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/vae/wan_2.1_vae.safetensors",
"directory": "vae"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan_2.1_vae.safetensors"
]
},
{
"id": 156,
"type": "GetVideoComponents",
"pos": [
510,
1120
],
"size": [
185.17734375,
66
],
"flags": {},
"order": 25,
"mode": 0,
"inputs": [
{
"name": "video",
"type": "VIDEO",
"link": 277
}
],
"outputs": [
{
"name": "images",
"type": "IMAGE",
"links": [
285
]
},
{
"name": "audio",
"type": "AUDIO",
"links": null
},
{
"name": "fps",
"type": "FLOAT",
"links": null
}
],
"properties": {
"Node name for S&R": "GetVideoComponents",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 159,
"type": "PreviewImage",
"pos": [
850,
1240
],
"size": [
360,
258
],
"flags": {},
"order": 32,
"mode": 4,
"inputs": [
{
"name": "images",
"type": "IMAGE",
"link": 279
}
],
"outputs": [],
"properties": {
"Node name for S&R": "PreviewImage",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 157,
"type": "Canny",
"pos": [
850,
1110
],
"size": [
360,
82
],
"flags": {},
"order": 29,
"mode": 4,
"inputs": [
{
"name": "image",
"type": "IMAGE",
"link": 285
}
],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"links": [
279,
286
]
}
],
"properties": {
"Node name for S&R": "Canny",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
0.1,
0.6
]
},
{
"id": 163,
"type": "CreateVideo",
"pos": [
1650,
1960
],
"size": [
270,
78
],
"flags": {},
"order": 40,
"mode": 4,
"inputs": [
{
"name": "images",
"type": "IMAGE",
"link": 300
},
{
"name": "audio",
"shape": 7,
"type": "AUDIO",
"link": null
}
],
"outputs": [
{
"name": "VIDEO",
"type": "VIDEO",
"links": [
307
]
}
],
"properties": {
"Node name for S&R": "CreateVideo",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
16
]
},
{
"id": 164,
"type": "VAEDecode",
"pos": [
1650,
1860
],
"size": [
210,
46
],
"flags": {},
"order": 38,
"mode": 4,
"inputs": [
{
"name": "samples",
"type": "LATENT",
"link": 301
},
{
"name": "vae",
"type": "VAE",
"link": 302
}
],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"slot_index": 0,
"links": [
300
]
}
],
"properties": {
"Node name for S&R": "VAEDecode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 167,
"type": "CLIPLoader",
"pos": [
110,
2170
],
"size": [
340,
110
],
"flags": {},
"order": 4,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "CLIP",
"type": "CLIP",
"slot_index": 0,
"links": [
299,
317
]
}
],
"properties": {
"Node name for S&R": "CLIPLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/resolve/main/split_files/text_encoders/umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"directory": "text_encoders"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"umt5_xxl_fp8_e4m3fn_scaled.safetensors",
"wan",
"default"
]
},
{
"id": 168,
"type": "VAELoader",
"pos": [
110,
2340
],
"size": [
344.731689453125,
59.98149108886719
],
"flags": {},
"order": 5,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "VAE",
"type": "VAE",
"slot_index": 0,
"links": [
302,
320
]
}
],
"properties": {
"Node name for S&R": "VAELoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan_2.1_vae.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/vae/wan_2.1_vae.safetensors",
"directory": "vae"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan_2.1_vae.safetensors"
]
},
{
"id": 165,
"type": "UNETLoader",
"pos": [
120,
1890
],
"size": [
320,
82
],
"flags": {},
"order": 6,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
323
]
}
],
"properties": {
"Node name for S&R": "UNETLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"directory": "diffusion_models"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors",
"default"
]
},
{
"id": 166,
"type": "UNETLoader",
"pos": [
120,
2020
],
"size": [
320,
90
],
"flags": {},
"order": 7,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
325
]
}
],
"properties": {
"Node name for S&R": "UNETLoader",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"models": [
{
"name": "wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"directory": "diffusion_models"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors",
"default"
]
},
{
"id": 179,
"type": "CLIPTextEncode",
"pos": [
490,
2150
],
"size": [
422.84503173828125,
164.31304931640625
],
"flags": {},
"order": 21,
"mode": 4,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 317
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"slot_index": 0,
"links": [
318
]
}
],
"title": "CLIP Text Encode (Positive Prompt)",
"properties": {
"Node name for S&R": "CLIPTextEncode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"On a sunny summer day, there are marshmallow - like clouds, and the sunlight is bright and warm. A girl with white curly double - ponytails is wearing unique sunglasses, distinctive clothes and shoes. Her posture is natural and full of dynamic tension. The background is the scene of the Leaning Tower of Pisa in Italy, emphasizing the realistic contrast of details in reality. The whole picture is in a realistic 3D style, rich in details and with a relaxed atmosphere. She is dancing slowly, waving her hands."
],
"color": "#232",
"bgcolor": "#353"
},
{
"id": 180,
"type": "Wan22FunControlToVideo",
"pos": [
970,
2160
],
"size": [
270,
210
],
"flags": {},
"order": 31,
"mode": 4,
"inputs": [
{
"name": "positive",
"type": "CONDITIONING",
"link": 318
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 319
},
{
"name": "vae",
"type": "VAE",
"link": 320
},
{
"name": "ref_image",
"shape": 7,
"type": "IMAGE",
"link": 321
},
{
"name": "control_video",
"shape": 7,
"type": "IMAGE",
"link": 322
}
],
"outputs": [
{
"name": "positive",
"type": "CONDITIONING",
"links": [
304,
312
]
},
{
"name": "negative",
"type": "CONDITIONING",
"links": [
305,
313
]
},
{
"name": "latent",
"type": "LATENT",
"links": [
306
]
}
],
"properties": {
"Node name for S&R": "Wan22FunControlToVideo",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {
"width": true,
"height": true,
"length": true,
"batch_size": true
}
}
},
"widgets_values": [
640,
640,
81,
1
]
},
{
"id": 171,
"type": "GetVideoComponents",
"pos": [
510,
2590
],
"size": [
185.17734375,
66
],
"flags": {
"collapsed": true
},
"order": 24,
"mode": 4,
"inputs": [
{
"name": "video",
"type": "VIDEO",
"link": 308
}
],
"outputs": [
{
"name": "images",
"type": "IMAGE",
"links": [
310
]
},
{
"name": "audio",
"type": "AUDIO",
"links": null
},
{
"name": "fps",
"type": "FLOAT",
"links": null
}
],
"properties": {
"Node name for S&R": "GetVideoComponents",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 173,
"type": "Canny",
"pos": [
830,
2560
],
"size": [
360,
82
],
"flags": {},
"order": 28,
"mode": 4,
"inputs": [
{
"name": "image",
"type": "IMAGE",
"link": 310
}
],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"links": [
309,
322
]
}
],
"properties": {
"Node name for S&R": "Canny",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
0.1,
0.6
]
},
{
"id": 175,
"type": "KSamplerAdvanced",
"pos": [
1290,
2530
],
"size": [
300,
340
],
"flags": {},
"order": 36,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 311
},
{
"name": "positive",
"type": "CONDITIONING",
"link": 312
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 313
},
{
"name": "latent_image",
"type": "LATENT",
"link": 314
}
],
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
301
]
}
],
"properties": {
"Node name for S&R": "KSamplerAdvanced",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"disable",
0,
"fixed",
4,
1,
"euler",
"simple",
2,
4,
"disable"
]
},
{
"id": 169,
"type": "KSamplerAdvanced",
"pos": [
1290,
1850
],
"size": [
304.748046875,
334
],
"flags": {},
"order": 34,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 303
},
{
"name": "positive",
"type": "CONDITIONING",
"link": 304
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 305
},
{
"name": "latent_image",
"type": "LATENT",
"link": 306
}
],
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
314
]
}
],
"properties": {
"Node name for S&R": "KSamplerAdvanced",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"enable",
342522439403882,
"randomize",
4,
1,
"euler",
"simple",
0,
2,
"enable"
]
},
{
"id": 176,
"type": "ModelSamplingSD3",
"pos": [
990,
1850
],
"size": [
210,
60
],
"flags": {},
"order": 26,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 324
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
303
]
}
],
"properties": {
"Node name for S&R": "ModelSamplingSD3",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
8.000000000000002
]
},
{
"id": 181,
"type": "LoraLoaderModelOnly",
"pos": [
530,
1850
],
"size": [
270,
82
],
"flags": {},
"order": 22,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 323
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"links": [
324
]
}
],
"properties": {
"Node name for S&R": "LoraLoaderModelOnly",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"models": [
{
"name": "wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors",
"directory": "loras"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {
"lora_name": true,
"strength_model": true
}
}
},
"widgets_values": [
"wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors",
1
]
},
{
"id": 177,
"type": "ModelSamplingSD3",
"pos": [
990,
1980
],
"size": [
210,
58
],
"flags": {},
"order": 27,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 326
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
311
]
}
],
"properties": {
"Node name for S&R": "ModelSamplingSD3",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
8.000000000000002
]
},
{
"id": 182,
"type": "LoraLoaderModelOnly",
"pos": [
530,
1980
],
"size": [
270,
82
],
"flags": {},
"order": 23,
"mode": 4,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 325
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"links": [
326
]
}
],
"properties": {
"Node name for S&R": "LoraLoaderModelOnly",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"models": [
{
"name": "wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors",
"url": "https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors",
"directory": "loras"
}
],
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {
"lora_name": true,
"strength_model": true
}
}
},
"widgets_values": [
"wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors",
1
]
},
{
"id": 91,
"type": "CLIPTextEncode",
"pos": [
500,
880
],
"size": [
420,
130
],
"flags": {},
"order": 18,
"mode": 0,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 164
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"slot_index": 0,
"links": [
288
]
}
],
"title": "CLIP Text Encode (Negative Prompt)",
"properties": {
"Node name for S&R": "CLIPTextEncode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"色调艳丽，过曝，静态，细节模糊不清，字幕，风格，作品，画作，画面，静止，整体发灰，最差质量，低质量，JPEG压缩残留，丑陋的，残缺的，多余的手指，画得不好的手部，画得不好的脸部，畸形的，毁容的，形态畸形的肢体，手指融合，静止不动的画面，杂乱的背景，三条腿，背景人很多，倒着走"
],
"color": "#322",
"bgcolor": "#533"
},
{
"id": 99,
"type": "CLIPTextEncode",
"pos": [
500,
650
],
"size": [
420,
180
],
"flags": {},
"order": 19,
"mode": 0,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 178
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"slot_index": 0,
"links": [
289
]
}
],
"title": "CLIP Text Encode (Positive Prompt)",
"properties": {
"Node name for S&R": "CLIPTextEncode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"On a sunny summer day, there are marshmallow - like clouds, and the sunlight is bright and warm. A girl with white curly double - ponytails is wearing unique sunglasses, distinctive clothes and shoes. Her posture is natural and full of dynamic tension. The background is the scene of the Leaning Tower of Pisa in Italy, emphasizing the realistic contrast of details in reality. The whole picture is in a realistic 3D style, rich in details and with a relaxed atmosphere. She is dancing slowly, waving her hands."
],
"color": "#232",
"bgcolor": "#353"
},
{
"id": 145,
"type": "LoadImage",
"pos": [
110,
1150
],
"size": [
340,
326
],
"flags": {},
"order": 8,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"slot_index": 0,
"links": [
284
]
},
{
"name": "MASK",
"type": "MASK",
"slot_index": 1,
"links": null
}
],
"properties": {
"Node name for S&R": "LoadImage",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video_wan2_2_14B_fun_control_start_image.jpg",
"image"
],
"color": "#322",
"bgcolor": "#533"
},
{
"id": 160,
"type": "Wan22FunControlToVideo",
"pos": [
970,
720
],
"size": [
270,
210
],
"flags": {},
"order": 33,
"mode": 0,
"inputs": [
{
"name": "positive",
"type": "CONDITIONING",
"link": 289
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 288
},
{
"name": "vae",
"type": "VAE",
"link": 287
},
{
"name": "ref_image",
"shape": 7,
"type": "IMAGE",
"link": 284
},
{
"name": "control_video",
"shape": 7,
"type": "IMAGE",
"link": 286
}
],
"outputs": [
{
"name": "positive",
"type": "CONDITIONING",
"links": [
295,
297
]
},
{
"name": "negative",
"type": "CONDITIONING",
"links": [
294,
298
]
},
{
"name": "latent",
"type": "LATENT",
"links": [
296
]
}
],
"properties": {
"Node name for S&R": "Wan22FunControlToVideo",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {
"width": true,
"height": true,
"length": true,
"batch_size": true
}
}
},
"widgets_values": [
640,
640,
81,
1
]
},
{
"id": 95,
"type": "KSamplerAdvanced",
"pos": [
1330,
1100
],
"size": [
300,
340
],
"flags": {},
"order": 37,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 245
},
{
"name": "positive",
"type": "CONDITIONING",
"link": 297
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 298
},
{
"name": "latent_image",
"type": "LATENT",
"link": 281
}
],
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
175
]
}
],
"properties": {
"Node name for S&R": "KSamplerAdvanced",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"disable",
0,
"fixed",
20,
3.5,
"euler",
"simple",
10,
10000,
"disable"
]
},
{
"id": 93,
"type": "ModelSamplingSD3",
"pos": [
580,
460
],
"size": [
210,
60
],
"flags": {},
"order": 16,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 244
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
243
]
}
],
"properties": {
"Node name for S&R": "ModelSamplingSD3",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
8.000000000000002
]
},
{
"id": 94,
"type": "ModelSamplingSD3",
"pos": [
1040,
460
],
"size": [
210,
58
],
"flags": {},
"order": 17,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 246
}
],
"outputs": [
{
"name": "MODEL",
"type": "MODEL",
"slot_index": 0,
"links": [
245
]
}
],
"properties": {
"Node name for S&R": "ModelSamplingSD3",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
8.000000000000002
]
},
{
"id": 96,
"type": "KSamplerAdvanced",
"pos": [
1330,
420
],
"size": [
304.748046875,
334
],
"flags": {},
"order": 35,
"mode": 0,
"inputs": [
{
"name": "model",
"type": "MODEL",
"link": 243
},
{
"name": "positive",
"type": "CONDITIONING",
"link": 295
},
{
"name": "negative",
"type": "CONDITIONING",
"link": 294
},
{
"name": "latent_image",
"type": "LATENT",
"link": 296
}
],
"outputs": [
{
"name": "LATENT",
"type": "LATENT",
"links": [
281
]
}
],
"properties": {
"Node name for S&R": "KSamplerAdvanced",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"enable",
909895218860439,
"randomize",
20,
3.5,
"euler",
"simple",
0,
10,
"enable"
]
},
{
"id": 170,
"type": "SaveVideo",
"pos": [
1650,
2100
],
"size": [
620,
718
],
"flags": {},
"order": 42,
"mode": 4,
"inputs": [
{
"name": "video",
"type": "VIDEO",
"link": 307
}
],
"outputs": [],
"properties": {
"Node name for S&R": "SaveVideo",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video/wan2.2_fun_control",
"auto",
"auto"
]
},
{
"id": 98,
"type": "SaveVideo",
"pos": [
1700,
660
],
"size": [
620,
718.0000610351562
],
"flags": {},
"order": 43,
"mode": 0,
"inputs": [
{
"name": "video",
"type": "VIDEO",
"link": 177
}
],
"outputs": [],
"properties": {
"Node name for S&R": "SaveVideo",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video/wan2.2_fun_control",
"auto",
"auto"
]
},
{
"id": 172,
"type": "PreviewImage",
"pos": [
840,
2680
],
"size": [
360,
258
],
"flags": {},
"order": 30,
"mode": 4,
"inputs": [
{
"name": "images",
"type": "IMAGE",
"link": 309
}
],
"outputs": [],
"properties": {
"Node name for S&R": "PreviewImage",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": []
},
{
"id": 174,
"type": "LoadVideo",
"pos": [
500,
2660
],
"size": [
274.080078125,
348.0800781250002
],
"flags": {},
"order": 9,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "VIDEO",
"type": "VIDEO",
"links": [
308
]
}
],
"properties": {
"Node name for S&R": "LoadVideo",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video_wan2_2_14B_fun_control_start_image_control_video.mp4",
"image"
]
},
{
"id": 162,
"type": "CLIPTextEncode",
"pos": [
490,
2350
],
"size": [
430,
110
],
"flags": {},
"order": 20,
"mode": 4,
"inputs": [
{
"name": "clip",
"type": "CLIP",
"link": 299
}
],
"outputs": [
{
"name": "CONDITIONING",
"type": "CONDITIONING",
"slot_index": 0,
"links": [
319
]
}
],
"title": "CLIP Text Encode (Negative Prompt)",
"properties": {
"Node name for S&R": "CLIPTextEncode",
"cnr_id": "comfy-core",
"ver": "0.3.45",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"色调艳丽，过曝，静态，细节模糊不清，字幕，风格，作品，画作，画面，静止，整体发灰，最差质量，低质量，JPEG压缩残留，丑陋的，残缺的，多余的手指，画得不好的手部，画得不好的脸部，畸形的，毁容的，形态畸形的肢体，手指融合，静止不动的画面，杂乱的背景，三条腿，背景人很多，倒着走"
],
"color": "#223",
"bgcolor": "#335"
},
{
"id": 178,
"type": "LoadImage",
"pos": [
110,
2580
],
"size": [
340,
340
],
"flags": {},
"order": 10,
"mode": 4,
"inputs": [],
"outputs": [
{
"name": "IMAGE",
"type": "IMAGE",
"slot_index": 0,
"links": [
321
]
},
{
"name": "MASK",
"type": "MASK",
"slot_index": 1,
"links": null
}
],
"properties": {
"Node name for S&R": "LoadImage",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video_wan2_2_14B_fun_control_start_image.jpg",
"image"
]
},
{
"id": 158,
"type": "LoadVideo",
"pos": [
510,
1230
],
"size": [
274.080078125,
348.0800781250002
],
"flags": {},
"order": 11,
"mode": 0,
"inputs": [],
"outputs": [
{
"name": "VIDEO",
"type": "VIDEO",
"links": [
277
]
}
],
"properties": {
"Node name for S&R": "LoadVideo",
"cnr_id": "comfy-core",
"ver": "0.3.49",
"enableTabs": false,
"tabWidth": 65,
"tabXOffset": 10,
"hasSecondTab": false,
"secondTabText": "Send Back",
"secondTabOffset": 80,
"secondTabWidth": 65,
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"video_wan2_2_14B_fun_control_start_image_control_video.mp4",
"image"
]
},
{
"id": 185,
"type": "MarkdownNote",
"pos": [
830,
1620
],
"size": [
420,
120
],
"flags": {},
"order": 12,
"mode": 0,
"inputs": [],
"outputs": [],
"title": "About Control Video",
"properties": {},
"widgets_values": [
"You may need the following custom nodes to preprocess the control video:\n1. [comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux)\n2. [ComfyUI-DepthAnythingV2](https://github.com/kijai/ComfyUI-DepthAnythingV2)\n\nYou can find the control video we use [here](https://docs.comfy.org/tutorials/video/wan/wan2-2-fun-control).\n\nThis model supports multiple control conditions such as Canny, Depth, Pose, and trajectory control."
],
"color": "#432",
"bgcolor": "#653"
},
{
"id": 183,
"type": "Note",
"pos": [
80,
180
],
"size": [
360,
100
],
"flags": {},
"order": 13,
"mode": 0,
"inputs": [],
"outputs": [],
"properties": {},
"widgets_values": [
"Using the Wan2.2 Lighting LoRA will result in the loss of video dynamics, but it will reduce the generation time. This template provides two workflows, and you can enable one as needed."
],
"color": "#432",
"bgcolor": "#653"
},
{
"id": 161,
"type": "MarkdownNote",
"pos": [
-470,
500
],
"size": [
530,
550
],
"flags": {},
"order": 14,
"mode": 0,
"inputs": [],
"outputs": [],
"properties": {
"ue_properties": {
"widget_ue_connectable": {}
}
},
"widgets_values": [
"[Tutorial](https://docs.comfy.org/tutorials/video/wan/wan2-2-fun-control\n) \n\n**Diffusion Model**\n- [wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors)\n- [wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/diffusion_models/wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors)\n\n**LoRA**\n- [wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors)\n- [wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/loras/wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors)\n\n**VAE**\n- [wan_2.1_vae.safetensors](https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/resolve/main/split_files/vae/wan_2.1_vae.safetensors)\n\n**Text Encoder** \n- [umt5_xxl_fp8_e4m3fn_scaled.safetensors](https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/resolve/main/split_files/text_encoders/umt5_xxl_fp8_e4m3fn_scaled.safetensors)\n\n\nFile save location\n\n```\nComfyUI/\n├───📂 models/\n│ ├───📂 diffusion_models/\n│ │ ├─── wan2.2_fun_control_low_noise_14B_fp8_scaled.safetensors\n│ │ └─── wan2.2_fun_control_high_noise_14B_fp8_scaled.safetensors\n│ ├───📂 loras/\n│ │ ├─── wan2.2_i2v_lightx2v_4steps_lora_v1_high_noise.safetensors\n│ │ └─── wan2.2_i2v_lightx2v_4steps_lora_v1_low_noise.safetensors\n│ ├───📂 text_encoders/\n│ │ └─── umt5_xxl_fp8_e4m3fn_scaled.safetensors \n│ └───📂 vae/\n│ └── wan_2.1_vae.safetensors\n```\n"
],
"color": "#432",
"bgcolor": "#653"
},
{
"id": 186,
"type": "MarkdownNote",
"pos": [
-460,
330
],
"size": [
520,
130
],
"flags": {},
"order": 15,
"mode": 0,
"inputs": [],
"outputs": [],
"title": "Note: About Wan2.2 Fun Control",
"properties": {},
"widgets_values": [
"Wan2.2-Fun-Control is a 14B-parameter video generation model launched by Alibaba PAI, supporting multiple control conditions such as Canny, Depth, Pose and trajectory control. \n\nIt enables multi-resolution (512/768/1024) video prediction, trained with 81 frames and 16 FPS, and supports multilingual generation."
],
"color": "#432",
"bgcolor": "#653"
}
],
"links": [
[
164,
90,
0,
91,
0,
"CLIP"
],
[
175,
95,
0,
97,
0,
"LATENT"
],
[
176,
92,
0,
97,
1,
"VAE"
],
[
177,
100,
0,
98,
0,
"VIDEO"
],
[
178,
90,
0,
99,
0,
"CLIP"
],
[
179,
97,
0,
100,
0,
"IMAGE"
],
[
243,
93,
0,
96,
0,
"MODEL"
],
[
244,
101,
0,
93,
0,
"MODEL"
],
[
245,
94,
0,
95,
0,
"MODEL"
],
[
246,
102,
0,
94,
0,
"MODEL"
],
[
277,
158,
0,
156,
0,
"VIDEO"
],
[
279,
157,
0,
159,
0,
"IMAGE"
],
[
281,
96,
0,
95,
3,
"LATENT"
],
[
284,
145,
0,
160,
3,
"IMAGE"
],
[
285,
156,
0,
157,
0,
"IMAGE"
],
[
286,
157,
0,
160,
4,
"IMAGE"
],
[
287,
92,
0,
160,
2,
"VAE"
],
[
288,
91,
0,
160,
1,
"CONDITIONING"
],
[
289,
99,
0,
160,
0,
"CONDITIONING"
],
[
294,
160,
1,
96,
2,
"CONDITIONING"
],
[
295,
160,
0,
96,
1,
"CONDITIONING"
],
[
296,
160,
2,
96,
3,
"LATENT"
],
[
297,
160,
0,
95,
1,
"CONDITIONING"
],
[
298,
160,
1,
95,
2,
"CONDITIONING"
],
[
299,
167,
0,
162,
0,
"CLIP"
],
[
300,
164,
0,
163,
0,
"IMAGE"
],
[
301,
175,
0,
164,
0,
"LATENT"
],
[
302,
168,
0,
164,
1,
"VAE"
],
[
303,
176,
0,
169,
0,
"MODEL"
],
[
304,
180,
0,
169,
1,
"CONDITIONING"
],
[
305,
180,
1,
169,
2,
"CONDITIONING"
],
[
306,
180,
2,
169,
3,
"LATENT"
],
[
307,
163,
0,
170,
0,
"VIDEO"
],
[
308,
174,
0,
171,
0,
"VIDEO"
],
[
309,
173,
0,
172,
0,
"IMAGE"
],
[
310,
171,
0,
173,
0,
"IMAGE"
],
[
311,
177,
0,
175,
0,
"MODEL"
],
[
312,
180,
0,
175,
1,
"CONDITIONING"
],
[
313,
180,
1,
175,
2,
"CONDITIONING"
],
[
314,
169,
0,
175,
3,
"LATENT"
],
[
317,
167,
0,
179,
0,
"CLIP"
],
[
318,
179,
0,
180,
0,
"CONDITIONING"
],
[
319,
162,
0,
180,
1,
"CONDITIONING"
],
[
320,
168,
0,
180,
2,
"VAE"
],
[
321,
178,
0,
180,
3,
"IMAGE"
],
[
322,
173,
0,
180,
4,
"IMAGE"
],
[
323,
165,
0,
181,
0,
"MODEL"
],
[
324,
181,
0,
176,
0,
"MODEL"
],
[
325,
166,
0,
182,
0,
"MODEL"
],
[
326,
182,
0,
177,
0,
"MODEL"
]
],
"groups": [
{
"id": 8,
"title": "Step1 - Load models",
"bounding": [
90,
370,
380,
650
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 10,
"title": "Step 4 - Prompt",
"bounding": [
490,
580,
440,
440
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 13,
"title": "Step 2 - Start_image",
"bounding": [
90,
1040,
380,
490
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 14,
"title": "Step 3 - Control video and video preprocessing",
"bounding": [
490,
1040,
780,
490
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 15,
"title": "Step 5 - Video size & length",
"bounding": [
950,
580,
320,
440
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 22,
"title": "Wan2.2 Fun Control fp8 scaled+ 4 steps LoRA",
"bounding": [
80,
1770,
2280,
1250
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 16,
"title": "Step1 - Load models",
"bounding": [
90,
1810,
380,
660
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 17,
"title": "Step 4 - Prompt",
"bounding": [
480,
2080,
450,
390
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 18,
"title": "Step 2 - Start_image",
"bounding": [
90,
2490,
380,
470
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 19,
"title": "Step 3 - Control video and video preprocessing",
"bounding": [
480,
2490,
780,
520
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 20,
"title": "Step 5 - Video size & length",
"bounding": [
940,
2080,
330,
390
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
},
{
"id": 23,
"title": "Default workflow",
"bounding": [
80,
300,
2260,
1240
],
"color": "#3f789e",
"font_size": 24,
"flags": {}
}
],
"config": {},
"extra": {
"ds": {
"scale": 0.26464743043131467,
"offset": [
2218.5905846587248,
394.9507204830435
]
},
"frontendVersion": "1.32.1",
"VHS_latentpreview": false,
"VHS_latentpreviewrate": 0,
"VHS_MetadataImage": true,
"VHS_KeepIntermediate": true,
"ue_links": [],
"links_added_by_ue": []
},
"version": 0.4
}
Reference in New Issue View Git Blame Copy Permalink