【stablediffusion】AI视频王者归来~！CogVideo:重磅升级！图生视频完美镜头控制和3D环绕,商用级开源AI视频曙光

最新推荐文章于 2025-03-26 15:39:06 发布

AI画师安琪

最新推荐文章于 2025-03-26 15:39:06 发布

阅读量1.3k

点赞数 5

文章标签： stable diffusion 人工智能 3d AIGC 人工智能作画 midjourney AI作画

本文链接：https://blog.csdn.net/2401_85725028/article/details/143741594

版权

今天，我们将向您介绍一款令人兴奋的更新——Stable Diffusion的AI视频生成工具CogVideo。这是一款基于Stable Diffusion技术的AI视频生成工具，旨在为您提供一键式生成高质量视频的便捷体验。无论您是AI视频的新手还是专业人士，这个工具都能为您带来极大的便利。

CogVideo工具引入了图生视频功能，能够实现完美镜头控制和3D环绕效果。通过这个工具，您可以轻松地生成具有高度真实感的视频，让您的作品更加生动、有趣。此外，CogVideo工具还具备多种视频生成风格和效果，能够满足您不同的创作需求。

在这个教程中，我们将详细介绍CogVideo工具的使用方法和高级功能。通过这个工具，您可以轻松地实现图生视频功能，同时享受多种视频生成风格和效果。同时，我们还将提供全网最详细的Stable Diffusion CogVideo工具使用方法和参数设置诀窍，让您能够更好地掌握这个工具。

所以，如果您对Stable Diffusion和CogVideo工具充满好奇，或者想要尝试一下这个有趣的功能，那就赶紧试试吧！它将会给您带来无尽的惊喜和乐趣！

在这里插入图片描述

CogVideo简介

在之前的文章已经多次介绍过智普开源的视频生成模型：CogVideoX。在当前AI视频开源领域主要为Mochi和CogVideoX两大主力。在社区生态的快速迭代中，两大视频模型视频生成质量也是快速的提升。Mochi从开源初的2张H100 显存要求在社区量化等优化手段下，如果已经可以在4090消费级显卡上推理运行了。而CogVideoX也发布了最新的1.5版本支持不仅支持文生视频和图生视频，当前图生视频也支持了任意长宽比的视频生成了。以及CogVideoX还开放了LORA体系，社区也逐步的推出了首批CogVideoX LORA模型。今天文章的主题就聚焦中CogVideoX首批LORA模型中代表模型:运镜模型。当视频模型涌现大量LORA和ControlNet那距离成熟已不远（期待开源视频界Flux-Dev）。

CogVideo运镜 ComfyUI体验

首先需要更新ComfyUI并通过插件管理器Git安装ComfyUI-CogVideoXWrapper，模型会在首次运行时候自动下载。注意选择图生视频模型：CogVideoX-5b-I2V。

• 插件地址：https://github.com/kijai/ComfyUI-CogVideoXWrapper
• CogVideoX-5b-I2V模型：模型会在首次自动下载，如需手动下载模型，则需要下载整个项目全部文件，并放置**/ComfyUI/models/CogVideo/CogVideoX-5b-I2V**。下载地址：https://huggingface.co/THUDM/CogVideoX-5b-I2V
• orbit_left_lora_weights.safetensors和orbit_up_lora_weights.safetensors：系在运镜LORA模型并放置到目录****/ComfyUI/models/CogVideo/loras****下。下载地址：文末网盘获取，或

https://huggingface.co/wenqsun/DimensionX/tree/main

在这里插入图片描述

Flux文生图工作流

在这里插入图片描述

另外LIBLIBAI已支持本地客户端使用可首页下载体验。

CogVideo运镜工作流

在这里插入图片描述

注意：

• 这里新增了一个CogVideoLoraSelectLORA节点，作为运镜LORA加载器
• CogVideoLoraSelect节点的fuse_lora需要设置为true，CogVideoDecode节点的enable_vae_tiling设置为true减少显存使用。另外如果低显存可启用fp8_transformer

01. 猛犸象群

Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.

在这里插入图片描述

02.城市上空游动的鲸鱼

Whales swim in the air. In the mesmerizing nightscape, a colossal whale glides gracefully through the star-studded sky, its vast, textured body illuminated by the soft, ethereal glow of the moon. The city below, a sprawling metropolis of towering skyscrapers, twinkles with countless lights, creating a captivating contrast between the urban jungle and the serene marine giant. The sky, painted in deep shades of blue and adorned with twinkling stars, adds a dreamlike quality to the scene. The whale, seemingly in motion, appears to be swimming through the clouds, its majestic form a surreal and awe-inspiring sight against the backdrop of the illuminated cityscape

在这里插入图片描述

03.鸡尾酒调制

In a cozy, well-lit kitchen, a man in a black apron and blue cap is meticulously crafting a cocktail. He stands behind a white countertop, expertly pouring a rich, amber liquid from a shaker into a martini glass. The scene is filled with various bottles of alcohol, a juicer, and other bar tools, indicating a well-equipped home bar. The window behind him reveals a serene suburban view, adding a touch of calm to the focused atmosphere. His precise movements and the array of ingredients suggest a passion for mixology, creating a moment of artistry in an everyday setting.

在这里插入图片描述

04.3D镜头旋转

The image depicts a breathtaking landscape bathed in the warm, golden hues of a setting sun. The sky is a dramatic canvas of swirling clouds, painted in shades of pink, orange, and purple, creating a mesmerizing backdrop. The lush green meadow stretches out, dotted with vibrant wildflowers swaying gently in the breeze. Towering trees, their leaves tinged with the soft glow of the sun, stand sentinel along the winding dirt path that meanders through the scene. The overall atmosphere is serene and idyllic, capturing the tranquil beauty of nature at its finest.

在这里插入图片描述

05.愤怒嘶吼

A man with tousled dark hair stands in a dramatic landscape, his eyes blazing with fury as he surveys the chaotic scene around him. Clad in a rugged leather jacket, he turns slightly, revealing a determined posture amid a backdrop of crumbling mountains and a valley littered with abandoned structures and scattered flags. The sky is overcast, adding a somber tone to the atmosphere, accentuating his emotional intensity. The camera captures a medium shot, focusing on his tense expression and the desolation surrounding him. The visual style is cinematic with high contrast, enhancing the grim and powerful mood of the moment.

在这里插入图片描述

05.旋转灯塔

In the heart of a frozen landscape, a majestic lighthouse stands tall, its stone walls blanketed in a thick layer of snow. The lighthouse, adorned with icicles, emanates a warm, golden glow from its windows, contrasting beautifully with the ethereal green and purple hues of the Northern Lights dancing across the night sky. The icy waters surrounding the structure are dotted with jagged ice formations, creating a surreal and otherworldly scene. The lighthouse keeper’s footsteps, lightly imprinted in the snow, lead up the steps to the welcoming wooden door, hinting at the warmth and safety within. The serene, almost magical atmosphere is palpable, as if time itself has slowed to admire this breathtaking winter wonderland.

在这里插入图片描述