[ComfyUI]重磅升级,FLUX.1-dev-ControlNet-Union-Pro-2.0发布,更好用了

一、ControlNet-Union-Pro-2.0 介绍

玩过Flux都知道这里面门道有多深,Flux的ControlNet效果一直不如SD1.5的好,昨天 Shakker-Labs 发布了第二代的ControlNet-Union-Pro模型,让我很开心,这不得好好测试一下效果。

和上一代对比,官方说有如下更新:

  • 删除模式嵌入,模型尺寸更小 6.15G->3.98G
  • 改进canny和pose,更好的控制和美感。
  • 添加对软边缘soft edge的支持。移除对tile的支持。

该模型支持多种控制模式,包括canny, soft edge, depth, pose, gray。您可以像使用普通的 ControlNet 网络一样使用它。

二、相关安装

模型地址:https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0/tree/main

三、使用对比

工作流已上传以下2个平台:

  • RH在线运行:https://www.runninghub.cn/post/1912664033240252418?inviteCode=kol01-rh024

  • Liblib下载:https://www.liblib.art/modelinfo/fe1171424ef2484ba282128d116bead0

下面我们就来测试对比下Union-Pro-2.0 VS -Union-Pro的效果

深度Depth测试

来个风景的

This is a photograph capturing a serene, misty forest scene with a traditional Japanese torii gate at its center. The gate, made of dark wooden pillars and a thatched roof, stands on a stone pathway flanked by lush greenery and small rocks. Sunlight filters through the dense trees, creating a mystical ambiance. The pathway leads deeper into the forest, inviting exploration. The overall color palette is rich greens and soft light, enhancing the tranquil, almost ethereal atmosphere.

openpose测试
photograph A photograph of a young East Asian woman with fair skin, long straight brown hair, and a slender build. She wears a light blue sundress adorned with white floral patterns, a matching blue headband, and hoop earrings. The setting is a bright, airy café with large windows revealing lush greenery outside. She sits at a wooden table, holding a plate with pastries. The overall ambiance is serene and summery., 50mm . cinematic 4k epic detailed 4k epic detailed photograph shot on kodak detailed cinematic hbo dark moody, 35mm photo, grainy, vignette, vintage, Kodachrome, Lomography, stained, highly detailed, found footage

cinematic photo This is a photograph featuring two young women dressed in matching, frilly, white maid outfits with puffy sleeves and ruffled aprons. They wear white cat ear headbands and white high heels. Both have long, straight black hair and fair skin. The woman on the left has a slightly curvier figure, while the one on the right is slimmer. They stand against a wooden wardrobe in a room with soft, light-colored curtains and a plush teddy bear in the background. . 35mm photograph, film, bokeh, professional, 4k, highly detailed

soft edge

软边缘控制模式是刚支持的,我们也来测试几组

This is a photograph of a modern living room featuring a sleek, cylindrical air purifier with a black and orange design, emitting a gentle puff of steam. The room is light-filled, with beige walls and a minimalist aesthetic. A grey sofa with plush cushions sits against the wall, adorned with monochrome floral artwork. A potted plant adds a touch of greenery on the left. The floor is polished light wood. The overall scene exudes a clean, contemporary vibe.

canny
This is a digital CGI artwork featuring an adorable, blue-haired, anime-style elf girl with large, expressive blue eyes and a cute, innocent smile. She has light skin, small antler-like horns, and is dressed in a white kimono with blue accents. She sits at a wooden desk, writing in a notebook with a quill. The background shows a cozy room with a wooden chest, potted plant, and framed pictures. The overall style is whimsical and charming, with soft, pastel colors enhancing the scene's warm and inviting atmosphere.

可以看到,Union-Pro-2.0 相比较第一代来说,效果确实好了一些,主要还是显存占用更低了,这样结合Flux使用就不容易内存溢出了,真不错。

四、在线使用

云端镜像

大家如果没有本地 ComfyUI 环境,或者本地显卡配置低于 16G 的,可以使用嘟嘟部署的仙宫云镜像,可直接加载使用。后续分享的工作流都会更像到镜像中,一周更新一次,方便大学学习。

目前整合了2个镜像,一个是Flux绘图用的,另外一个是针对视频模型的,之所以分开是一些模型兼容问题,分开比较好处理。

镜像名称:嘟嘟AI绘画趣味学


云平台镜像地址:

https://www.xiangongyun.com/image/detail/d961a7dc-ade3-4bd5-a7c6-92ac49ff5e4b?r=37BCLY

https://www.xiangongyun.com/image/detail/81716d29-4461-4b0b-ba4b-7b9b7dd569d3?r=37BCLY

新用户通过邀请码注册,总共可获得 8 元奖励,体验 4 个小时的 4090 作图时长

RH平台

推荐不想本地自己折腾的同学一个可在线使用Runninghub平台可在线体验AI应用和工作流(注册即送1000积分可用)。

https://www.runninghub.cn/?inviteCode=kol01-rh024

主页更多精彩工作流可在线体验: https://www.runninghub.cn/user-center/1865434314359058434?inviteCode=kol01-rh024

五、总结

以上就是最新的FLux Controlnet模型的测评了,非常不错,显存占用小了,效果确更好了,这下FLux生态的CN控制器终于加强了,可玩性就更高了。

AI时代,值得我们去投入时间研究。

技术的迭代是飞快的,要关注最新的消息才不会掉队。​

嘟嘟每天分享最新的ComfyUI技术前沿。​

本篇中的工作流和模型网盘链接:https://pan.quark.cn/s/171db5b939ea

我是嘟嘟,专注于 AI 绘画以及 AI 工具分享,欢迎来一起交流。​

如果觉得文章有帮助,请帮忙点赞收藏关注一下呦~​

### 关于 FLUX1-dev-fp8 的技术文档及相关信息 FLUX1-dev-fp8 是一款基于 FP8 浮点精度优化的深度学习模型,在特定应用场景下提供了显著的性能提升[^1]。该模型不仅继承了 FLUX 系列产品的优势特性,还针对开发者的需求进行了多项改进。 #### 社区资源与支持 对于寻求更多关于 FLUX1-dev-fp8 技术细节的支持和技术交流机会而言,活跃的技术社区是一个宝贵的资源库。InstantX/FLUX.1-dev-Controlnet-Union 和 Shakker-Labs 维护的相关 GitHub 仓库中包含了大量由用户贡献的内容以及官方发布的资料,涵盖了从基础入门到高级应用的各种教程和案例分享[^3]。 #### 官方文档的重要性 考虑到不同版本间可能存在功能性差异及随时间推移而产生的操作流程变更,查阅最新版官方文档显得尤为重要。这不仅能确保使用者掌握最前沿的功能特性,还能有效规避因过时信息而导致的操作失误[^4]。 ```python import requests def fetch_latest_docs(model_name="FLUX1-dev-fp8"): url = f"https://docs.example.com/{model_name}/latest" response = requests.get(url) if response.status_code == 200: return response.text else: raise Exception(f"Failed to retrieve documentation for {model_name}") print(fetch_latest_docs()) ``` 此段 Python 代码展示了如何通过 API 获取指定型号(此处为 FLUX1-dev-fp8)最新的在线文档内容。请注意替换 `https://docs.example.com` 为你所关注的具体项目站点地址。
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值