一、ControlNet-Union-Pro-2.0 介绍
玩过Flux都知道这里面门道有多深,Flux的ControlNet效果一直不如SD1.5的好,昨天 Shakker-Labs 发布了第二代的ControlNet-Union-Pro模型,让我很开心,这不得好好测试一下效果。
和上一代对比,官方说有如下更新:
- 删除模式嵌入,模型尺寸更小 6.15G->3.98G。
- 改进canny和pose,更好的控制和美感。
- 添加对软边缘soft edge的支持。移除对tile的支持。
该模型支持多种控制模式,包括canny, soft edge, depth, pose, gray。您可以像使用普通的 ControlNet 网络一样使用它。
二、相关安装
模型地址:https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0/tree/main
三、使用对比
工作流已上传以下2个平台:
-
RH在线运行:https://www.runninghub.cn/post/1912664033240252418?inviteCode=kol01-rh024
-
Liblib下载:https://www.liblib.art/modelinfo/fe1171424ef2484ba282128d116bead0
下面我们就来测试对比下Union-Pro-2.0 VS -Union-Pro的效果
深度Depth测试
来个风景的
This is a photograph capturing a serene, misty forest scene with a traditional Japanese torii gate at its center. The gate, made of dark wooden pillars and a thatched roof, stands on a stone pathway flanked by lush greenery and small rocks. Sunlight filters through the dense trees, creating a mystical ambiance. The pathway leads deeper into the forest, inviting exploration. The overall color palette is rich greens and soft light, enhancing the tranquil, almost ethereal atmosphere.
openpose测试
photograph A photograph of a young East Asian woman with fair skin, long straight brown hair, and a slender build. She wears a light blue sundress adorned with white floral patterns, a matching blue headband, and hoop earrings. The setting is a bright, airy café with large windows revealing lush greenery outside. She sits at a wooden table, holding a plate with pastries. The overall ambiance is serene and summery., 50mm . cinematic 4k epic detailed 4k epic detailed photograph shot on kodak detailed cinematic hbo dark moody, 35mm photo, grainy, vignette, vintage, Kodachrome, Lomography, stained, highly detailed, found footage
cinematic photo This is a photograph featuring two young women dressed in matching, frilly, white maid outfits with puffy sleeves and ruffled aprons. They wear white cat ear headbands and white high heels. Both have long, straight black hair and fair skin. The woman on the left has a slightly curvier figure, while the one on the right is slimmer. They stand against a wooden wardrobe in a room with soft, light-colored curtains and a plush teddy bear in the background. . 35mm photograph, film, bokeh, professional, 4k, highly detailed
soft edge
软边缘控制模式是刚支持的,我们也来测试几组
This is a photograph of a modern living room featuring a sleek, cylindrical air purifier with a black and orange design, emitting a gentle puff of steam. The room is light-filled, with beige walls and a minimalist aesthetic. A grey sofa with plush cushions sits against the wall, adorned with monochrome floral artwork. A potted plant adds a touch of greenery on the left. The floor is polished light wood. The overall scene exudes a clean, contemporary vibe.
canny
This is a digital CGI artwork featuring an adorable, blue-haired, anime-style elf girl with large, expressive blue eyes and a cute, innocent smile. She has light skin, small antler-like horns, and is dressed in a white kimono with blue accents. She sits at a wooden desk, writing in a notebook with a quill. The background shows a cozy room with a wooden chest, potted plant, and framed pictures. The overall style is whimsical and charming, with soft, pastel colors enhancing the scene's warm and inviting atmosphere.
可以看到,Union-Pro-2.0 相比较第一代来说,效果确实好了一些,主要还是显存占用更低了,这样结合Flux使用就不容易内存溢出了,真不错。
四、在线使用
云端镜像
大家如果没有本地 ComfyUI 环境,或者本地显卡配置低于 16G 的,可以使用嘟嘟部署的仙宫云镜像,可直接加载使用。后续分享的工作流都会更像到镜像中,一周更新一次,方便大学学习。
目前整合了2个镜像,一个是Flux绘图用的,另外一个是针对视频模型的,之所以分开是一些模型兼容问题,分开比较好处理。
镜像名称:嘟嘟AI绘画趣味学
云平台镜像地址:
https://www.xiangongyun.com/image/detail/d961a7dc-ade3-4bd5-a7c6-92ac49ff5e4b?r=37BCLY
https://www.xiangongyun.com/image/detail/81716d29-4461-4b0b-ba4b-7b9b7dd569d3?r=37BCLY
新用户通过邀请码注册,总共可获得 8 元奖励,体验 4 个小时的 4090 作图时长。
RH平台
推荐不想本地自己折腾的同学一个可在线使用Runninghub平台可在线体验AI应用和工作流(注册即送1000积分可用)。
https://www.runninghub.cn/?inviteCode=kol01-rh024
主页更多精彩工作流可在线体验: https://www.runninghub.cn/user-center/1865434314359058434?inviteCode=kol01-rh024
五、总结
以上就是最新的FLux Controlnet模型的测评了,非常不错,显存占用小了,效果确更好了,这下FLux生态的CN控制器终于加强了,可玩性就更高了。
AI时代,值得我们去投入时间研究。
技术的迭代是飞快的,要关注最新的消息才不会掉队。
嘟嘟每天分享最新的ComfyUI技术前沿。
本篇中的工作流和模型网盘链接:https://pan.quark.cn/s/171db5b939ea
我是嘟嘟,专注于 AI 绘画以及 AI 工具分享,欢迎来一起交流。
如果觉得文章有帮助,请帮忙点赞收藏关注一下呦~