MMagic代码课

• 来源
  • 玩转AIGC神器MMagic_哔哩哔哩_bilibili
• 包含领域
  • 生成模型
  • 底层视觉
  • AIGC
• 应用场景
  • 视频插帧
  • 视频超分辨率
  • 图像修复填充
  • 抠出图像前景
  • 文生图
  • 3D感知生成
• 安装MMagic

# 安装mmcv和mmengine
pip3 install openmim
mim install "mmcv>=2.0.0"
mim install "mmengine"

# 下载mmagic源码
rm -rf mmagic
git clone https://github.com/open-mmlab/mmagic.git

# 从源码安装mmagic
pip3 install -e . -i https://pypi.tuna.tsinghua.edu.cn/simple

• 黑白照片上色
  • Instance-aware Image Colorization

python mmagic/demo/mmagic_inference_demo.py \
        --model-name inst_colorization \
        --img test_colorization.jpg \
        --result-out-dir out_colorization.png

• 文生图
  • Stable Diffusion
  • DreamBooth

# 导入工具包
from mmagic.apis import MMagicInferencer

# 载入Stable Diffusion模型
sd_inferencer = MMagicInferencer(model_name="stable_diffusion")

# 指定Prompt文本
text_prompts = "A panda is having dinner at KFC"

text_prompts = "A Persian cat walking in the streets of New York"

# 指定Prompt文本
sd_inferencer.infer(text=text_prompts, result_out_dir="output/sd_res.png")

• 图生图
  • ControlNet-Canny
  • ControlNet-Pose
  • ControlNet Animation