ComfyUI | 智谱版Sora正式开源，6秒直出电影级画质。

最新推荐文章于 2024-10-04 22:36:54 发布

AIGC阿道夫

最新推荐文章于 2024-10-04 22:36:54 发布

阅读量942

点赞数 13

文章标签：人工智能 stable diffusion AI作画 ai绘画 aigc 人工智能作画 ai

本文链接：https://blog.csdn.net/text2203/article/details/141027568

版权

前段时间，智谱刚开放了他们的 AI 文生视频以及图生视频的体验入口清影-AI 生视频。

没想到这么快，智谱就把和清影同源的视频模型 CogVideoX 开源了，就在昨天，智谱开源了 CogVideoX 系列视频生成模型的第一个模型：CogVideoX-2B。

可以直接在本地进行部署，而且对本地配置的要求并不高，只需要 16G 显存就可以生成视频。

再来说效果，CogVideoX 应该最好的开源 AI 文生视频大模型了。

好了，话不多说，我们直接开整。

1.介绍

智谱发布AI 生视频产品「清影」，30秒将任意文图生成视频，并上线在他们的AI助手「智谱清言」上，被誉为是国内首个人人可用的Sora。随后，「清影」生成到视频数便已突破了百万量级。

近期，智谱AI宣布将与「清影」同源的视频生成模型——CogVideoX正式开源。

团队表示，希望每一位开发者、每一家企业都能自由地开发属于自己的视频生成模型，从而推动整个行业的快速迭代与创新发展。

随着大型模型技术的持续发展，视频生成技术正逐步走向成熟。

以Sora、Gen-3等闭源视频生成模型为代表的技术，正在重新定义行业的未来格局。

然而，截至目前，仍未有一个开源的视频生成模型，能够满足商业级应用的要求。

CogVideoX系列包含多个不同尺寸大小的开源模型。

目前已经开源的CogVideoX-2B，提示词上限为226个token，视频长度为6秒，帧率为8帧/秒，视频分辨率为720×480。

它在FP-16精度下的推理仅需18GB显存，微调则只需要40GB显存。这意味着单张4090显卡即可进行推理，而单张A6000显卡即可完成微调。

（需要的同学可以自行扫描获取）

#02

/成果展示

A detailed wooden toy ship with intricately carved masts and sails is seen gliding smoothly over a plush, blue carpet that mimics the waves of the sea. The ship’s hull is painted a rich brown, with tiny windows. The carpet, soft and textured, provides a perfect backdrop, resembling an oceanic expanse. Surrounding the ship are various other toys and children’s items, hinting at a playful environment. The scene captures the innocence and imagination of childhood, with the toy ship’s journey symbolizing endless adventures in a whimsical, indoor setting.

The camera follows behind a white vintage SUV with a black roof rack as it speeds up a steep dirt road surrounded by pine trees on a steep mountain slope, dust kicks up from it’s tires, the sunlight shines on the SUV as it speeds along the dirt road, casting a warm glow over the scene. The dirt road curves gently into the distance, with no other cars or vehicles in sight. The trees on either side of the road are redwoods, with patches of greenery scattered throughout. The car is seen from the rear following the curve with ease, making it seem as if it is on a rugged drive through the rugged terrain. The dirt road itself is surrounded by steep hills and mountains, with a clear blue sky above with wispy clouds.

In the haunting backdrop of a war-torn city, where ruins and crumbled walls tell a story of devastation, a poignant close-up frames a young girl. Her face is smudged with ash, a silent testament to the chaos around her. Her eyes glistening with a mix of sorrow and resilience, capturing the raw emotion of a world that has lost its innocence to the ravages of conflict.

A snowy forest landscape with a dirt road running through it. The road is flanked by trees covered in snow, and the ground is also covered in snow. The sun is shining, creating a bright and serene atmosphere. The road appears to be empty, and there are no people or animals visible in the video. The style of the video is a natural landscape shot, with a focus on the beauty of the snowy forest and the peacefulness of the road.