SV3D在ComfyUI中的部署

下载链接

• comfyui: https://github.com/comfyanonymous/ComfyUI

• 权重文件：https://huggingface.co/stabilityai/sv3d/tree/main

• comfyui管理器： https://github.com/ltdrdata/ComfyUI-Manager

一、下载comfyui

打开上面第一条链接，往下划

到installing这里，点Direct link to download,进行comfyui的下载

下载完成后解压即可

二、下载权重文件

打开上面第二条链接，找到sv3d_u_safetensors文件，点击进行下载

三、配置comfyui

温馨提示

想方便一点的话可以直接看四、工作流

找到你前面下载的comfyui文件，点进去

点进去找到custom_nodes文件夹，点进去（路径：ComfyUI_windows_portable > ComfyUI > custom_nodes），我这里已经配置好了所以会有其它文件，没配置的就还没有

打开你的cmd，输入git clone https://github.com/ltdrdata/ComfyUI-Manager（或者你用什么方法把这个仓库clone下来放到这个文件夹就行）

然后回到文件夹这一页，点击最下面的run_nvidia_gpu.bat

等一会就会出现以下界面，我们的界面或许会有些许不同，但是都大差不差

然后点击右边的Manager

点击中间最上面的custom nodes manager

在上面搜索下载comfyui frame interpolation和comfyui-videohelpersuite,最终效果如下

接下来就是配置我们的权重文件

打开路径：ComfyUI_windows_portable > ComfyUI > models>checkpoints

把你前面下载的sv3d_u_safetensors放到这里

四、工作流

复制下面这个工作流

{
  "last_node_id": 29,
  "last_link_id": 15,
  "nodes": [
    {
      "id": 3,
      "type": "VideoTriangleCFGGuidance",
      "pos": [
        411,
        72
      ],
      "size": {
        "0": 315,
        "1": 58
      },
      "flags": {},
      "order": 2,
      "mode": 0,
      "inputs": [
        {
          "name": "model",
          "type": "MODEL",
          "link": 1
        }
      ],
      "outputs": [
        {
          "name": "MODEL",
          "type": "MODEL",
          "links": [
            5
          ],
          "shape": 3,
          "slot_index": 0
        }
      ],
      "properties": {
        "Node name for S&R": "VideoTriangleCFGGuidance"
      },
      "widgets_values": [
        1
      ]
    },
    {
      "id": 5,
      "type": "SV3D_Conditioning",
      "pos": [
        372,
        317
      ],
      "size": {
        "0": 315,
        "1": 170
      },
      "flags": {},
      "order": 3,
      "mode": 0,
      "inputs": [
        {
          "name": "clip_vision",
          "type": "CLIP_VISION",
          "link": 2
        },
        {
          "name": "init_image",
          "type": "IMAGE",
          "link": 4,
          "slot_index": 1
        },
        {
          "name": "vae",
          "type": "VAE",
          "link": 3
        }
      ],
      "outputs": [
        {
          "name": "positive",
          "type": "CONDITIONING",
          "links": [
            7
          ],
          "shape": 3
        },
        {
          "name": "negative",
          "type": "CONDITIONING",
          "links": [
            6
          ],
          "shape": 3,
          "slot_index": 1
        },
        {
          "name": "latent",
          "type": "LATENT",
          "links": [
            8
          ],
          "shape": 3,
          "slot_index": 2
        }
      ],
      "properties": {
        "Node name for S&R": "SV3D_Conditioning"
      },
      "widgets_values": [
        576,
        576,
        21,
        0
      ]
    },
    {
      "id": 6,
      "type": "KSampler",
      "pos": [
        783,
        218
      ],
      "size": {
        "0": 315,
        "1": 262
      },
      "flags": {},
      "order": 4,
      "mode": 0,
      "inputs": [
        {
          "name": "model",
          "type": "MODEL",
          "link": 5
        },
        {
          "name": "positive",
          "type": "CONDITIONING",
          "link": 7,
          "slot_index": 1
        },
        {
          "name": "negative",
          "type": "CONDITIONING",
          "link": 6
        },
        {
          "name": "latent_image",
          "type": "LATENT",
          "link": 8
        }
      ],
      "outputs": [
        {
          "name": "LATENT",
          "type": "LATENT",
          "links": [
            9
          ],
          "shape": 3
        }
      ],
      "properties": {
        "Node name for S&R": "KSampler"
      },
      "widgets_values": [
        212672527265310,
        "randomize",
        20,
        8,
        "euler",
        "normal",
        0.9400000000000001
      ]
    },
    {
      "id": 27,
      "type": "ImageOnlyCheckpointLoader",
      "pos": [
        -47,
        146
      ],
      "size": {
        "0": 369.6000061035156,
        "1": 98
      },
      "flags": {},
      "order": 0,
      "mode": 0,
      "outputs": [
        {
          "name": "MODEL",
          "type": "MODEL",
          "links": [
            1
          ],
          "shape": 3,
          "slot_index": 0
        },
        {
          "name": "CLIP_VISION",
          "type": "CLIP_VISION",
          "links": [
            2
          ],
          "shape": 3,
          "slot_index": 1
        },
        {
          "name": "VAE",
          "type": "VAE",
          "links": [
            3,
            13
          ],
          "shape": 3,
          "slot_index": 2
        }
      ],
      "properties": {
        "Node name for S&R": "ImageOnlyCheckpointLoader"
      },
      "widgets_values": [
        "sv3d_u.safetensors"
      ]
    },
    {
      "id": 2,
      "type": "LoadImage",
      "pos": [
        -70,
        410
      ],
      "size": {
        "0": 315,
        "1": 314
      },
      "flags": {},
      "order": 1,
      "mode": 0,
      "outputs": [
        {
          "name": "IMAGE",
          "type": "IMAGE",
          "links": [
            4
          ],
          "shape": 3
        },
        {
          "name": "MASK",
          "type": "MASK",
          "links": null,
          "shape": 3
        }
      ],
      "properties": {
        "Node name for S&R": "LoadImage"
      },
      "widgets_values": [
        "QQ图片20240726020543.jpg",
        "image"
      ]
    },
    {
      "id": 7,
      "type": "VAEDecode",
      "pos": [
        1104,
        75
      ],
      "size": {
        "0": 210,
        "1": 46
      },
      "flags": {},
      "order": 5,
      "mode": 0,
      "inputs": [
        {
          "name": "samples",
          "type": "LATENT",
          "link": 9,
          "slot_index": 0
        },
        {
          "name": "vae",
          "type": "VAE",
          "link": 13,
          "slot_index": 1
        }
      ],
      "outputs": [
        {
          "name": "IMAGE",
          "type": "IMAGE",
          "links": [
            11,
            15
          ],
          "shape": 3,
          "slot_index": 0
        }
      ],
      "properties": {
        "Node name for S&R": "VAEDecode"
      }
    },
    {
      "id": 29,
      "type": "VHS_VideoCombine",
      "pos": [
        1534,
        47
      ],
      "size": [
        315,
        547
      ],
      "flags": {},
      "order": 7,
      "mode": 0,
      "inputs": [
        {
          "name": "images",
          "type": "IMAGE",
          "link": 15
        },
        {
          "name": "audio",
          "type": "AUDIO",
          "link": null
        },
        {
          "name": "meta_batch",
          "type": "VHS_BatchManager",
          "link": null
        },
        {
          "name": "vae",
          "type": "VAE",
          "link": null
        }
      ],
      "outputs": [
        {
          "name": "Filenames",
          "type": "VHS_FILENAMES",
          "links": null,
          "shape": 3
        }
      ],
      "properties": {
        "Node name for S&R": "VHS_VideoCombine"
      },
      "widgets_values": {
        "frame_rate": 8,
        "loop_count": 0,
        "filename_prefix": "AnimateDiff",
        "format": "image/gif",
        "pingpong": false,
        "save_output": true,
        "videopreview": {
          "hidden": false,
          "paused": false,
          "params": {
            "filename": "AnimateDiff_00001.gif",
            "subfolder": "",
            "type": "output",
            "format": "image/gif",
            "frame_rate": 8
          }
        }
      }
    },
    {
      "id": 26,
      "type": "SaveImage",
      "pos": [
        949,
        299
      ],
      "size": {
        "0": 545.411865234375,
        "1": 381.4376220703125
      },
      "flags": {},
      "order": 6,
      "mode": 0,
      "inputs": [
        {
          "name": "images",
          "type": "IMAGE",
          "link": 11,
          "slot_index": 0
        }
      ],
      "properties": {},
      "widgets_values": [
        "ComfyUI"
      ]
    }
  ],
  "links": [
    [
      1,
      27,
      0,
      3,
      0,
      "MODEL"
    ],
    [
      2,
      27,
      1,
      5,
      0,
      "CLIP_VISION"
    ],
    [
      3,
      27,
      2,
      5,
      2,
      "VAE"
    ],
    [
      4,
      2,
      0,
      5,
      1,
      "IMAGE"
    ],
    [
      5,
      3,
      0,
      6,
      0,
      "MODEL"
    ],
    [
      6,
      5,
      1,
      6,
      2,
      "CONDITIONING"
    ],
    [
      7,
      5,
      0,
      6,
      1,
      "CONDITIONING"
    ],
    [
      8,
      5,
      2,
      6,
      3,
      "LATENT"
    ],
    [
      9,
      6,
      0,
      7,
      0,
      "LATENT"
    ],
    [
      11,
      7,
      0,
      26,
      0,
      "IMAGE"
    ],
    [
      13,
      27,
      2,
      7,
      1,
      "VAE"
    ],
    [
      15,
      7,
      0,
      29,
      0,
      "IMAGE"
    ]
  ],
  "groups": [],
  "config": {},
  "extra": {
    "ds": {
      "scale": 0.9090909090909091,
      "offset": [
        -685.2532775604243,
        71.84552970707234
      ]
    }
  },
  "version": 0.4
}

然后回到桌面，新建一个文本文档，改后缀为json

点进去，把刚刚复制的工作流（json）粘贴进来，保存退出

先复制进去再改后缀也是可以的

然后从桌面这把工作流拖进去就好了（如果拖进来变为红色，那说明你前面没配置好）

温馨提示

就是如果你不想进行前面的麻烦配置，你可以直接在manage里面点击install missing custom nodes就好，但是这样子比较容易出问题（没出问题说明你比较幸运），推荐使用三、配置comfyui

五、开始运行

前面配置好了的话就点这上传你的图片文件，然后点右边的queue prompt开始运行就好

一般来说到这里都能正常运行，但是可能也会有报错，报错的话得自己上网查查错误原因改一改就行