ComfyUI与Flux CN组件V3的结合,在AI艺术创作领域开启了新的篇章。本文将介绍XLabs官方发布的CN组件V3的特点和应用,以及它如何为您的艺术创作带来全新的可能性和便利。
Flux CN组件V3是一种基于深度学习的图像生成模型,能够根据用户输入的提示词生成高质量的图像。
该技术在艺术创作领域尤为突出,能够创作出具有独特艺术风格的AI艺术作品。
Flux ControlNet模型简介
在之前的文章中已经介绍过由XLabs-AI团队开发的最新Flux模型的最新的3款ControlNet模型(Canny硬边缘、深度Midas、线条HED),但是整体初步体验下来,整体质量还未达到可完美使用效果。但XLabs-AI团队在继续的推进和训练FLux ControlNet模型的进展,随着不久时间就由发布了这三款的ControlNet模型的V2、V3版本。今天的文章将一起体验和评测它的最新V3版本模型。笔者将长期跟踪和关注Flux模型生态的LORA、ControlNet,这也是Flux模型构建繁荣生态,以及取代SD1.5,SDXL的最后一公里的里程碑事件。
(需要的同学可以自行扫描获取Flux ControlNet模型及相关软件安装包)
另外,本次使用ControlNet,从V2版本开始,官方训练和推荐分辨率变为1024*1024。这与之前的是有区别的(v1版本中,深度:1024x1024分辨率 ;线稿Canny,HED使用 768x768 分辨率)。
XLabs-AI Flux ControlNet演示
XLabs-AI在其主页提供了这3类flux ControlNet的演示示例如下所示:
深度 (Midas)
HED
Flux ControlNet模型体验
当前最新版本的ComfyUI已支持Flux ControlNet模型的体验,同时还需要通过插件管理器Git安装x-flux-comfyui该插件。其中需要将模型放置到 ComfyUI/models/xlabs/controlnets目录下,如本地不存在该目录可以手工新建可以,也可以首次运行自动创建目录
另外这个版本出图耗显存较大,24G显存机器大约每张图25步迭代需要耗时1分钟。
(相关插件模型及工作流可自行扫描获取)
LIBLIBAI平台已支持Flux模型在线运行体验,并且笔者已增加换脸节点使用。工作流地址为:
一:硬边缘(Canny)
以下均使用CN权重幅度为0.7体验测试。
01. 室内设计
`Chinese style, cyberpank dining room, full hd, cinematic,sunshinex`输出效果
02. 偷鸡娃
Capture an energetic scene of a chubby little boy in rural China, shirtless, chubby belly, still clinging to dirt, wearing a pair of muddy white cloth shoes on his feet, and a mischievous and happy expression on his face, running through the muddy streets of the countryside. The dust was flying, and the little boy was clutching on his arm a large, strong rooster, whose feathers were a mixture of deep Burgundy and glittering gold, in stark contrast to the boy's plain clothes. The rooster frowns slightly, but is surprisingly calm, adding a whimsical twist to the energetic chase. The background is a rural wet market. The overall tone of the film is a lively and lively atmosphere, which summarizes the free and simple youth. The sun shines through the white clouds, casting dappled shadows, and the pleasant warm picture enhances the sense of movement and the joyous chaos of the moment.
输出效果
二:深度(Midas)
01. 室内设计
Chinese style, cyberpank dining room, full hd, cinematic,sunshine
输出效果
02. 偷鸡娃
Capture an energetic scene of a chubby little boy in rural China, shirtless, chubby belly, still clinging to dirt, wearing a pair of muddy white cloth shoes on his feet, and a mischievous and happy expression on his face, running through the muddy streets of the countryside. The dust was flying, and the little boy was clutching on his arm a large, strong rooster, whose feathers were a mixture of deep Burgundy and glittering gold, in stark contrast to the boy's plain clothes. The rooster frowns slightly, but is surprisingly calm, adding a whimsical twist to the energetic chase. The background is a rural wet market. The overall tone of the film is a lively and lively atmosphere, which summarizes the free and simple youth. The sun shines through the white clouds, casting dappled shadows, and the pleasant warm picture enhances the sense of movement and the joyous chaos of the moment.
输出效果
三:线条(HED)
01. 室内设计
Chinese style, cyberpank dining room, full hd, cinematic,sunshine
输出效果
02. 偷鸡娃
Capture an energetic scene of a chubby little boy in rural China, shirtless, chubby belly, still clinging to dirt, wearing a pair of muddy white cloth shoes on his feet, and a mischievous and happy expression on his face, running through the muddy streets of the countryside. The dust was flying, and the little boy was clutching on his arm a large, strong rooster, whose feathers were a mixture of deep Burgundy and glittering gold, in stark contrast to the boy's plain clothes. The rooster frowns slightly, but is surprisingly calm, adding a whimsical twist to the energetic chase. The background is a rural wet market. The overall tone of the film is a lively and lively atmosphere, which summarizes the free and simple youth. The sun shines through the white clouds, casting dappled shadows, and the pleasant warm picture enhances the sense of movement and the joyous chaos of the moment.
输出效果
四:线稿上色(Canny)
01. 背影杀手
1girl, chinese girl, 20-old-years, simple background,Turn your back on the audience, half backless,shadow killer, light red|yellow dress, transparent silk dress, white backgroound
输出效果
最后,整个V3版本ControlNet模型体验结果,相比之前的V1、V2版本已经取到了巨大的进度,更加完善,已逐步可用于出图实践中。对于大部分线稿图质量整体已能直出不错质量,在测试中仅对中国龙神态类型质量不太好,笔者猜测可能是因为训练数据问题。具体待读者测试和评价。需要说明,官方插件结合ControlNet模型运行特别耗费显存资源,这也是Flux Dev一直以来的问题。
资料软件免费放送
次日同一发放请耐心等待
学好 AI绘画 不论是就业还是做副业赚钱都不错,但要学会 AI绘画 还是要有一个学习规划。最后大家分享一份全套的 AI绘画 学习资料,给那些想学习 AI绘画 的小伙伴们一点帮助!
需要的可以扫描下方CSDN官方认证二维码免费领取【保证100%免费】
**一、AIGC所有方向的学习路线**
AIGC所有方向的技术点做的整理,形成各个领域的知识点汇总,它的用处就在于,你可以按照下面的知识点去找对应的学习资源,保证自己学得较为全面。
二、AIGC必备工具
工具都帮大家整理好了,安装就可直接上手!
三、最新AIGC学习笔记
当我学到一定基础,有自己的理解能力的时候,会去阅读一些前辈整理的书籍或者手写的笔记资料,这些笔记详细记载了他们对一些技术点的理解,这些理解是比较独到,可以学到不一样的思路。
四、AIGC视频教程合集
观看全面零基础学习视频,看视频学习是最快捷也是最有效果的方式,跟着视频中老师的思路,从基础到深入,还是很容易入门的。
五、实战案例
纸上得来终觉浅,要学会跟着视频一起敲,要动手实操,才能将自己的所学运用到实际当中去,这时候可以搞点实战案例来学习。
这份完整版的学习资料已经上传CSDN,朋友们如果需要可以微信扫描下方CSDN官方认证二维码免费领取【保证100%免费】