Diffusers代码学习：Shap-E 3D改变视角

默认情况下，网格输出从底部视点聚焦。但是如上一篇的输出结果可以看到，有可能底部没有渲染上色。可以通过应用旋转变换来更改默认视点。

import os

# os.environ['KMP_DUPLICATE_LIB_OK']='True'
os.environ["HF_ENDPOINT"] = "https://hf-mirror.com"

import torch
from diffusers import ShapEPipeline

device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

pipe = ShapEPipeline.from_pretrained("openai/shap-e", torch_dtype=torch.float16, variant="fp16")
pipe = pipe.to(device)

guidance_scale = 15.0
prompt = "A birthday cupcake"

images = pipe(prompt, guidance_scale=guidance_scale, num_inference_steps=64, frame_size=256, output_type="mesh").images

from diffusers.utils import export_to_ply

ply_path = export_to_ply(images[0], "3d_cake.ply")
print(f"Saved to folder: {ply_path}")

import trimesh
import numpy as np

mesh = trimesh.load("3d_cake.ply")
rot = trimesh.transformations.rotation_matrix(-np.pi / 2, [1, 0, 0])
mesh = mesh.apply_transform(rot)
mesh_export = mesh.export("3d_cake.glb", file_type="glb")

这个蛋糕好看多了。

注意，如果遇到报错

OMP: Error #15: Initializing libiomp5md.dll, but found libiomp5md.dll already initialized.

就在需要在第一行import os后面增加

os.environ['KMP_DUPLICATE_LIB_OK']='True'