LTX-Video 0.9.1简介
在之前的文章已经介绍过LTX-Video这块高质量高效著称的视频模型,近期又迎来了版本的升级。在这次的版本升级为ltx-video-2b-v0.9.1.safetensors。该版本带来了以下主要新特性:
-
• 增强的图像到视频(i2v)和文本到视频(t2v)性能:通过额外的训练和数据,提升了模型在图像和文本生成视频方面的表现。
-
• 新VAE解码器:消除了闪烁纹理或运动抖动伪影,改善了视频生成的质量。
-
• 内置STG/PAG支持:为生成过程提供了更好的控制和灵活性。
-
• 改进的i2v:针对AI生成图像进行了优化,集成了图像降解系统,以改善i2v流中的运动生成效果。
-
• 高效性能:模型依然保持快速,并且能够在低内存配置的设备上运行。
-
• github:https://github.com/Lightricks/LTX-Video
-
• huggingface:https://huggingface.co/Lightricks/LTX-Video/tree/main
LTX-Video ComfyUI体验
需要注意的是在本次的更新中,更新了新的VAE模型,仅在ComfyUI-LTXVideo版本中得到了更新。ComfyUI官方本体插件还需要等待。
-
• ComfyUI-LTXVideo插件 :https://github.com/Lightricks/ComfyUI-LTXVideo
-
• Lightricks/LTX-Video:下载模型并放置在目录 /ComfyUI/mode****ls/checkpoints下。下载地址(文末网盘以放置):https://huggingface.co/Lightricks/LTX-Video
Flux文生图工作流
Flux文生图感兴趣的同学可参考LIBLIB在线运行工作流
本文涉及ComfyUI工作流和模型均可在LIBLIBAI上下载或在线运行体验:
• F.1-绮梦流光-水湄凝香:
https://www.liblib.art/modelinfo/134c6dd95aef48e98a22b24e003e026b
• 工作流-Flux文|图生图+LORA+提示反推一键切换工作流:
https://www.liblib.art/modelinfo/782aacd70f604da39e83368c696a02a8
LTX-Video ComfyUI工作流
LTX-Video ComfyUI工作流已上传LIBLIB平台:
https://www.liblib.art/modelinfo/9e6c5b586fdc48bd965a88ca274a4879?versionUuid=c66db6a8e8624a19ad665f81ccbbd8fa
注意:
- • 提示优化建议:可以借助图像反推插件反推提示词(在这里使用了PromGen Large 2.0提示词反推,,然后再此基础上手动添加运动描述或通过LLM(大型语言模型)进行添加,因为图像描述生成不捕捉运动元素。提示词风格参考:https://github.com/Lightricks/LTX-Video。例如提示词模板:
`The turquoise waves crash against the dark, jagged rocks of the shore, sending white foam spraying into the air. The scene is dominated by the stark contrast between the bright blue water and the dark, almost black rocks. The water is a clear, turquoise color, and the waves are capped with white foam. The rocks are dark and jagged, and they are covered in patches of green moss. The shore is lined with lush green vegetation, including trees and bushes. In the background, there are rolling hills covered in dense forest. The sky is cloudy, and the light is dim.`
- • 24G显存****大约27秒生成4秒高质量视频。同时支持任意宽高的图生视频,具有更强的可控性。
• 同时使用了LTXV Apply STG节点,显著提升了图生视频质量。
• LTX-Video不仅支持图生视频,还支持文生视频,因为输入图像提示,本文故选择了更可控的图生视频工作流。
01. 摩托
A man riding a motorcycle on a rural road near a gas station. the man, who appears to be in his mid-twenties, has short brown hair and a beard. he is wearing a black leather jacket, blue jeans, and a black helmet, and is seated on a red motorcycle. the motorcycle has a sleek design with a large headlight and chrome accents. the background features a red and white oil diner with a sign that says "OIL DINER." the road is lined with green grass and trees, and the man is focused on the road ahead.A guy riding a red motorcycle on a gorgeous road. The scene is captured in real-life footage.
02.财神
Statue of the God of wealth, the camera gradually from far and near to the god of wealth in front, A large, red and gold statue of a chinese man with a long beard, wearing a traditional red robe and a golden crown, standing in the middle of a city street with buildings in the background. the statue appears to be a large, imposing figure with a cheerful expression and a wide smile, holding a golden pot in both hands. the sky is clear and blue, and a white car is parked in front of the statue, adding a sense of contrast to the scene. the video is taken from a low angle, looking up at the statue. the overall effect is one of grandeur and happiness, with the statue standing tall in the center of the city. solo, smile, open mouth, black hair, holding, male focus, outdoors, sky, day, cloud, blue sky, white car, building, beard, city, motor vehicle, red jacket, faceless, building facade, tall building camera_angle: from below, art_style: giant statue, location: city street, background: buildings and trees, text: NA, distance_to_camera: full body, clothing: red robe with gold accents, video_composition: center, pants: NA;NA, accessory: crown, shoes: NA
03.舞台
An Asian supermodel's stage fashion show, ahead of the fashion pace in the spotlight, The scene is captured in real-life footage., A close-up shot of a woman with long black hair, wearing a brown leather jacket and gold hoop earrings. she has a neutral expression and is positioned in the middle of the video, with a blurred background. the woman appears to be of asian descent and has a slim body. her hair is styled in long hair and falls down her back, framing her face. she is looking directly at the camera with a serious expression. her eyes are large and brown, and she has dark eyeliner and mascara. her lips are painted with red lipstick, and her nose is also visible. the background is blurred, with soft lighting and blurred figures in the distance, creating a sense of depth and dimension. the video is high quality, with no jpeg artifacts, and is likely from a fashion show or presentation. 1girl, solo, long hair, looking at viewer, brown eyes, closed mouth, jewelry, jacket, upper body, earrings, blurry, lips, blurry background, brown jacket, makeup, eyeliner, red lips camera_angle: close up, art_style: video realistic, location: indoor, background: blurred indoor setting with blurred figures, text: NA, video_composition: middle, clothing: brown
04.酒吧
An Asian woman is sitting at the bar, talking to an Asian man, The scene is captured in real-life footage., A video-realistic shoot from the side about a man and a woman seated at a bar, both dressed in elegant red attire. the woman, on the right side of the video, is sitting on a wooden bar stool with her hand resting on her chin, looking directly at the camera with a serious expression. she has long black hair and is wearing a red, sleeveless, high-necked dress that accentuates her slim body. the man, positioned behind her, has a black suit jacket and a black shirt, and is seated in front of the bar with his upper body visible. the background features shelves filled with various bottles of alcohol, and a framed poster on the wall. the lighting is soft and warm, creating a cozy atmosphere. 1girl, long hair, breasts, looking at viewer, black hair, dress, sitting, closed mouth, jewelry, bare shoulders, sitting back, jacket, cup, indoors, black jacket, black dress, lips, bottle, chair, red dress, wine glass, red lips, alcohol, wine bottle, bar \(place\) camera_angle: from side, art_style: video realistic, location: bar, background: wooden bar with shelves of liquor bottles, text: NA,
05.冬雪
A young Chinese woman, wearing a white down jacket and a white scarf, looks directly at the audience as she walks down the street in Harbin, watching the snow fall around her, The scene is captured in real-life footage., A video-realistic shoot from a portrait camera angle about a young woman standing in the middle of a snowy street, looking directly at the camera with a neutral expression. the woman, who appears to be in her early twenties, has long black hair tied up in a ponytail and brown eyes. she is wearing a white coat with a hood and a white scarf around her neck, and her face is partially obscured by the scarf. the background shows a snowy city street with parked cars and buildings, and the video is slightly blurred, giving it a dreamy, ethereal quality. snowflakes are visible in the air, adding a sense of movement to the scene. the video has a shallow depth of field, focusing on the woman's face and upper body, making it a captivating and realistic representation of a winter scene. 1girl, solo, looking at viewer, black hair, long hair, brown eyes, jacket, outdoors, coat, tree, lips, snow, blurry, blurry background, winter, hood up, snowing, nose, white coat, realistic camera_angle: portrait, art_style: video realistic, location: outdoor, background: snowy street with buildings and cars, text: NA, distance_to
写在最后
感兴趣的小伙伴,赠送全套AIGC学习资料,包含AI绘画、AI人工智能等前沿科技教程和软件工具,具体看这里。
AIGC技术的未来发展前景广阔,随着人工智能技术的不断发展,AIGC技术也将不断提高。未来,AIGC技术将在游戏和计算领域得到更广泛的应用,使游戏和计算系统具有更高效、更智能、更灵活的特性。同时,AIGC技术也将与人工智能技术紧密结合,在更多的领域得到广泛应用,对程序员来说影响至关重要。未来,AIGC技术将继续得到提高,同时也将与人工智能技术紧密结合,在更多的领域得到广泛应用。
一、AIGC所有方向的学习路线
AIGC所有方向的技术点做的整理,形成各个领域的知识点汇总,它的用处就在于,你可以按照下面的知识点去找对应的学习资源,保证自己学得较为全面。
二、AIGC必备工具
工具都帮大家整理好了,安装就可直接上手!
三、最新AIGC学习笔记
当我学到一定基础,有自己的理解能力的时候,会去阅读一些前辈整理的书籍或者手写的笔记资料,这些笔记详细记载了他们对一些技术点的理解,这些理解是比较独到,可以学到不一样的思路。
四、AIGC视频教程合集
观看全面零基础学习视频,看视频学习是最快捷也是最有效果的方式,跟着视频中老师的思路,从基础到深入,还是很容易入门的。
五、实战案例
纸上得来终觉浅,要学会跟着视频一起敲,要动手实操,才能将自己的所学运用到实际当中去,这时候可以搞点实战案例来学习。