【2022 CCF BDCI 文心大模型创意项目】AI一键搞定全套写文稿

已于 2023-01-17 15:45:41 修改
阅读量654 收藏
点赞数
文章标签： 人工智能 python 深度学习
于 2023-01-15 20:00:18 首次发布
原文链接：https://aistudio.baidu.com/aistudio/projectdetail/4465743
版权

★★★ 本文源自AI Studio社区精品项目，【点击此处】查看更多精品内容 >>>

【2022 CCF BDCI 文心大模型创意项目】AI一键搞定全套写文稿加配图（文心大模型图文创作）

版本更新

  • 由于hub调用文心模型的接口发生变化，需要给定ak和sk，请到文心官方申请：wenxin.baidu.com
  • 由于文心模型版本更新，“儿童画”不能作为style传入，需要重新调整提示词
  • 调整API调用代码，以符合新版API

一、项目简介

  • 所谓绘本，就是一段文字，配上一幅图片，这个活儿现在可以让AI来做，只要给它一个题目
  • 这个试验项目，用的是百度文心大模型，只需要一个标题，剩下的事情AI全包了
  • 可能是预训练模型的问题，生成的图文还不是很理想，但是也比你憋了一晚上还写不出来强
  • 这里面，标题、摘要、内容、配图都有了，只差封装到HTML
  • 使用了两种方式来调用模型，第一种是通过paddlehub，第二种是使用文心开放API

二、使用paddlehub调用文心大模型生成图文

2.1 第一步：安装paddlehub，获取所需的模型

#升级一下pip
!pip install --upgrade pip

Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: pip in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (22.3.1)

# 提示需要这个版本的tqdm，但是好像不安装也行
!pip install tqdm==4.48.2 --user

Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting tqdm==4.48.2
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/28/7e/281edb5bc3274dfb894d90f4dbacfceaca381c2435ec6187a2c6f329aed7/tqdm-4.48.2-py2.py3-none-any.whl (68 kB)
Installing collected packages: tqdm
  Attempting uninstall: tqdm
    Found existing installation: tqdm 4.27.0
    Uninstalling tqdm-4.27.0:
      Successfully uninstalled tqdm-4.27.0
[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
paddlefsl 1.0.0 requires tqdm~=4.27.0, but you have tqdm 4.48.2 which is incompatible.[0m[31m
[0mSuccessfully installed tqdm-4.48.2

# 安装paddlehub
!pip install --upgrade paddlehub --user

Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: paddlehub in ./.data/webide/pip/lib/python3.7/site-packages (2.3.1)
Requirement already satisfied: opencv-python in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (4.6.0.66)
Requirement already satisfied: gunicorn>=19.10.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (20.0.4)
Requirement already satisfied: filelock in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (3.0.12)
Requirement already satisfied: numpy in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (1.19.5)
Requirement already satisfied: colorama in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (0.4.4)
Requirement already satisfied: gradio in ./.data/webide/pip/lib/python3.7/site-packages (from paddlehub) (3.14.0)
Requirement already satisfied: colorlog in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (4.1.0)
Requirement already satisfied: pyzmq in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (23.2.1)
Requirement already satisfied: packaging in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (21.3)
Requirement already satisfied: tqdm in ./.data/webide/pip/lib/python3.7/site-packages (from paddlehub) (4.48.2)
Requirement already satisfied: pyyaml in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (5.1.2)
Requirement already satisfied: paddlenlp>=2.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (2.1.1)
Requirement already satisfied: rarfile in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (3.1)
Requirement already satisfied: Pillow in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (8.2.0)
Requirement already satisfied: paddle2onnx>=0.5.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (1.0.0)
Requirement already satisfied: flask>=1.1.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (1.1.1)
Requirement already satisfied: visualdl>=2.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (2.4.0)
Requirement already satisfied: easydict in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (1.9)
Requirement already satisfied: matplotlib in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlehub) (2.2.3)
Requirement already satisfied: click>=5.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from flask>=1.1.0->paddlehub) (8.0.4)
Requirement already satisfied: Jinja2>=2.10.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from flask>=1.1.0->paddlehub) (3.0.0)
Requirement already satisfied: Werkzeug>=0.15 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from flask>=1.1.0->paddlehub) (0.16.0)
Requirement already satisfied: itsdangerous>=0.24 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from flask>=1.1.0->paddlehub) (1.1.0)
Requirement already satisfied: setuptools>=3.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gunicorn>=19.10.0->paddlehub) (41.4.0)
Requirement already satisfied: multiprocess in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.0.0->paddlehub) (0.70.11.1)
Requirement already satisfied: h5py in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.0.0->paddlehub) (2.9.0)
Requirement already satisfied: jieba in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.0.0->paddlehub) (0.42.1)
Requirement already satisfied: paddlefsl==1.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.0.0->paddlehub) (1.0.0)
Requirement already satisfied: seqeval in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlenlp>=2.0.0->paddlehub) (1.2.2)
Requirement already satisfied: requests~=2.24.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from paddlefsl==1.0.0->paddlenlp>=2.0.0->paddlehub) (2.24.0)
Collecting tqdm
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/16/33/6d8bd6a7c4238f383426b7593bf05bfd6d9e1f10c3084b56c0f14d973754/tqdm-4.27.0-py2.py3-none-any.whl (44 kB)
Requirement already satisfied: pandas in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl>=2.0.0->paddlehub) (1.1.5)
Requirement already satisfied: six>=1.14.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl>=2.0.0->paddlehub) (1.16.0)
Requirement already satisfied: bce-python-sdk in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl>=2.0.0->paddlehub) (0.8.53)
Requirement already satisfied: Flask-Babel>=1.0.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl>=2.0.0->paddlehub) (1.0.0)
Requirement already satisfied: protobuf>=3.11.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from visualdl>=2.0.0->paddlehub) (3.20.0)
Requirement already satisfied: pydantic in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (1.10.2)
Requirement already satisfied: pydub in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.25.1)
Requirement already satisfied: ffmpy in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.3.0)
Requirement already satisfied: websockets>=10.0 in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (10.4)
Requirement already satisfied: uvicorn in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.20.0)
Requirement already satisfied: markupsafe in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gradio->paddlehub) (2.0.1)
Requirement already satisfied: httpx in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.23.1)
Requirement already satisfied: fastapi in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.88.0)
Requirement already satisfied: fsspec in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (2022.11.0)
Requirement already satisfied: aiohttp in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (3.8.3)
Requirement already satisfied: altair in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gradio->paddlehub) (4.2.0)
Requirement already satisfied: pycryptodome in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from gradio->paddlehub) (3.9.9)
Requirement already satisfied: python-multipart in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (0.0.5)
Requirement already satisfied: orjson in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (3.8.3)
Requirement already satisfied: markdown-it-py[linkify,plugins] in ./.data/webide/pip/lib/python3.7/site-packages (from gradio->paddlehub) (2.1.0)
Requirement already satisfied: pytz in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->paddlehub) (2019.3)
Requirement already satisfied: python-dateutil>=2.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->paddlehub) (2.8.2)
Requirement already satisfied: cycler>=0.10 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->paddlehub) (0.10.0)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->paddlehub) (3.0.9)
Requirement already satisfied: kiwisolver>=1.0.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from matplotlib->paddlehub) (1.1.0)
Requirement already satisfied: importlib-metadata in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from click>=5.1->flask>=1.1.0->paddlehub) (4.2.0)
Requirement already satisfied: Babel>=2.3 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from Flask-Babel>=1.0.0->visualdl>=2.0.0->paddlehub) (2.8.0)
Requirement already satisfied: idna<3,>=2.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests~=2.24.0->paddlefsl==1.0.0->paddlenlp>=2.0.0->paddlehub) (2.8)
Requirement already satisfied: chardet<4,>=3.0.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests~=2.24.0->paddlefsl==1.0.0->paddlenlp>=2.0.0->paddlehub) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests~=2.24.0->paddlefsl==1.0.0->paddlenlp>=2.0.0->paddlehub) (1.25.6)
Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests~=2.24.0->paddlefsl==1.0.0->paddlenlp>=2.0.0->paddlehub) (2019.9.11)
Requirement already satisfied: aiosignal>=1.1.2 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (1.3.1)
Requirement already satisfied: multidict<7.0,>=4.5 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (6.0.3)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (4.0.2)
Requirement already satisfied: charset-normalizer<3.0,>=2.0 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (2.1.1)
Requirement already satisfied: frozenlist>=1.1.1 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (1.3.3)
Requirement already satisfied: asynctest==0.13.0 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (0.13.0)
Requirement already satisfied: typing-extensions>=3.7.4 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (4.3.0)
Requirement already satisfied: attrs>=17.3.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (22.1.0)
Requirement already satisfied: yarl<2.0,>=1.0 in ./.data/webide/pip/lib/python3.7/site-packages (from aiohttp->gradio->paddlehub) (1.8.2)
Requirement already satisfied: entrypoints in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair->gradio->paddlehub) (0.4)
Requirement already satisfied: jsonschema>=3.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair->gradio->paddlehub) (4.16.0)
Requirement already satisfied: toolz in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from altair->gradio->paddlehub) (0.12.0)
Requirement already satisfied: future>=0.6.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from bce-python-sdk->visualdl>=2.0.0->paddlehub) (0.18.0)
Requirement already satisfied: starlette==0.22.0 in ./.data/webide/pip/lib/python3.7/site-packages (from fastapi->gradio->paddlehub) (0.22.0)
Requirement already satisfied: anyio<5,>=3.4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from starlette==0.22.0->fastapi->gradio->paddlehub) (3.6.1)
Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in ./.data/webide/pip/lib/python3.7/site-packages (from httpx->gradio->paddlehub) (1.5.0)
Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in ./.data/webide/pip/lib/python3.7/site-packages (from httpx->gradio->paddlehub) (0.16.2)
Requirement already satisfied: sniffio in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from httpx->gradio->paddlehub) (1.3.0)
Requirement already satisfied: mdurl~=0.1 in ./.data/webide/pip/lib/python3.7/site-packages (from markdown-it-py[linkify,plugins]->gradio->paddlehub) (0.1.2)
Requirement already satisfied: mdit-py-plugins in ./.data/webide/pip/lib/python3.7/site-packages (from markdown-it-py[linkify,plugins]->gradio->paddlehub) (0.3.3)
Requirement already satisfied: linkify-it-py~=1.0 in ./.data/webide/pip/lib/python3.7/site-packages (from markdown-it-py[linkify,plugins]->gradio->paddlehub) (1.0.3)
Requirement already satisfied: dill>=0.3.3 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from multiprocess->paddlenlp>=2.0.0->paddlehub) (0.3.3)
Requirement already satisfied: scikit-learn>=0.21.3 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from seqeval->paddlenlp>=2.0.0->paddlehub) (0.22.1)
Requirement already satisfied: h11>=0.8 in ./.data/webide/pip/lib/python3.7/site-packages (from uvicorn->gradio->paddlehub) (0.14.0)
Requirement already satisfied: pkgutil-resolve-name>=1.3.10 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair->gradio->paddlehub) (1.3.10)
Requirement already satisfied: importlib-resources>=1.4.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair->gradio->paddlehub) (5.9.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from jsonschema>=3.0->altair->gradio->paddlehub) (0.18.1)
Requirement already satisfied: uc-micro-py in ./.data/webide/pip/lib/python3.7/site-packages (from linkify-it-py~=1.0->markdown-it-py[linkify,plugins]->gradio->paddlehub) (1.0.1)
Requirement already satisfied: joblib>=0.11 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from scikit-learn>=0.21.3->seqeval->paddlenlp>=2.0.0->paddlehub) (0.14.1)
Requirement already satisfied: scipy>=0.17.0 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from scikit-learn>=0.21.3->seqeval->paddlenlp>=2.0.0->paddlehub) (1.3.0)
Requirement already satisfied: zipp>=0.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from importlib-metadata->click>=5.1->flask>=1.1.0->paddlehub) (3.8.1)
Installing collected packages: tqdm
  Attempting uninstall: tqdm
    Found existing installation: tqdm 4.48.2
    Uninstalling tqdm-4.48.2:
      Successfully uninstalled tqdm-4.48.2
[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
sahi 0.10.1 requires tqdm>=4.48.2, but you have tqdm 4.27.0 which is incompatible.[0m[31m
[0mSuccessfully installed tqdm-4.27.0

# 获取模型，用于生成文本
!hub install ernie_zeus

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/setuptools/depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
[32m[2022-12-20 15:39:05,406] [    INFO][0m - Module ernie_zeus already installed in /home/aistudio/.paddlehub/modules/ernie_zeus[0m
[0m

# 获取模型，用于生成图片
!hub install ernie_vilg

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/setuptools/depends.py:2: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
[32m[2022-12-20 15:39:12,197] [    INFO][0m - Module ernie_vilg already installed in /home/aistudio/.paddlehub/modules/ernie_vilg[0m
[0m

2.2 第二步：导入一些包

  • 这些包在后面调用文心开放API的例子中也会用到
# 导入需要的包
#import json
import PIL.Image as Image
import random
#import numpy as np
from io import BytesIO
#import base64
import requests
import matplotlib.pyplot as plt
#import cv2
import os
import shutil

2.3 第三步：想一个标题，让AI来创作文章

# 由于api'发生变更，调用文心模型需要ak和sk，需要到文心官网申请ak和sk，网址：wenxin.baidu.com
# 我这里把ak和sk放到了一个文件里，请使用自己申请到的ak和sk
# 文件内只有两行，形如    ak = XXXXX
wx_ak = ""
wx_sk = ""
wenxin_apicfg = "wenxin.baidu.com"
with open(wenxin_apicfg) as f:
    i = 0    # 行计数，只读取2行
    for line in f:
        i += 1
        if i>2: break
        lbl,val = line.strip().split("=")
        lbl = lbl.strip()
        val = val.strip()
        if lbl == "ak":
            wx_ak = val
        elif lbl == "sk":
            wx_sk = val
        # print(line)

# paddlehub，创作文章
import paddlehub as hub

# 加载模型
model = hub.Module(name='ernie_zeus',ak = wx_ak,sk = wx_sk)
txt_title = "小猴和桃子"
txt_tail = "小猴爬到树上吃到了桃子"
input_dict = {
    "text": f"题目：《{txt_title}》\n\n结局：{txt_tail}\n\n正文：",
    "seq_len": 512,
    "topp": 0.5,
    "penalty_score": 2.0,
    "min_dec_len": 128,
    "is_unidirectional": True,
    "task_prompt": "novel",
    "mask_type":"paragraph",
    "min_dec_penalty_text":txt_tail,
    "stop_token":txt_tail
}
# 作文创作
result = model.custom_generation(**input_dict)
txt_content = result
print(txt_content)

一天，森林里的动物们都在为过新年而忙碌着。有些动物准备打扫卫生、做游戏；还有许多动物要买食品和礼物送给自己亲爱的家人或朋友。大象伯伯也不例外。他刚从集市回来就开始清理房间啦！它先把报纸铺平，然后再拿出抹布擦地板，接下去又用拖把仔细地拖干净每个角落……最后才请小猴子帮助自己搬东西呢！可是这只淘气包总喜欢玩耍，于是便想了一个办法—让桃树爷爷变成孙悟空站到上面当“千斤顶”，好爬得更高点儿吃掉那些桃子。果真如此，没几分钟工夫，小猴子已经坐在枝头享受起美味的水蜜桃了。

2.4 第四步：让AI来生成摘要

  • 摘要不能太长，后面要用摘要生成图片，参数长度有限制
# paddlehub,生成摘要
import paddlehub as hub

# 加载模型
model = hub.Module(name='ernie_zeus',ak = wx_ak,sk = wx_sk)
input_dict = {
    "text": f"文章：{txt_content}”\n\n摘要：",
    "seq_len": 64-len(txt_title)-6,    # 限制摘要长度,后面生成图片的输入参数不能太长
    "topp": 0.0,
    "penalty_score": 1.0,
    "min_dec_len": 4,
    "is_unidirectional": 0,
    "task_prompt": "Summarization"
}
# 文本摘要
result = model.custom_generation(**input_dict)
txt_smr = result
print(txt_smr)

一天，森林里的动物们都在为过新年而忙碌着。有些动物准备打扫卫生、做游戏；还有许多动物要买食品和礼物送给自

2.5 第五步：让AI来给文章配图

# 定义一个用于显示图片的函数
def show_pic(pic):
    plt.figure(dpi = 144)
    plt.axis('off')
    plt.imshow(pic)

# paddlehub,生成图片
import paddlehub as hub    # 导入paddlehub
ernie_vilg_module = hub.Module(name='ernie_vilg',ak=wx_ak,sk=wx_sk)    # 导入模型
if os.path.exists("./imgs/"):shutil.rmtree("./imgs/")    # 删除文件夹 
input_txt = f"儿童画,简笔画，插画,《{txt_title},{txt_smr}》"
results = ernie_vilg_module.generate_image(
    text_prompts=input_txt,    # 提示词
    style="油画",    # 图片类型
    topk = 10,    # 图片数量，最大10
    visualization = 1,
    output_dir="./imgs/")    # 图片保存目录
# 返回的results 就是图片列表,PIL的Image格式

# 将结果显示出来
for pic in results:
    show_pic(pic)

HBox(children=(IntProgress(value=0), HTML(value='')))


Saving Images...
Done

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

2.6 第六步：简单生成个HTML文档

  • doc.html 作为模板
  • 将生成的doc1.html和文件夹imgs下载到本地，使用浏览器打开doc1.html即可看到页面
# 重命名图片
def rename_pics(path):
    file_list=os.listdir(path)
    i=0
    for fname in file_list:
        ex_name = fname[fname.index('.'):]    # 扩展名
        old_name = os.path.join(path,fname)
        new_name = str(i)+ex_name
        new_name = os.path.join(path,new_name)
        os.rename(old_name,new_name)
        i+=1

rename_pics("./imgs/")

# 生成HTML文档
doc_template = open("./doc.html")
doc_file = "doc1.html"
img_uri = "./imgs/0.png"
if(os.path.exists(doc_file)):os.remove(doc_file)    # 删除已有的文件
with open(doc_file,"w",encoding='utf-8') as f:
    for line in doc_template:
        f.write(
            line.replace(
                "{{page_title}}",txt_title).replace(
                    "{{txt_title}}", txt_title).replace(
                        "{{txt_smr}}", "【文章摘要】"+txt_smr).replace(
                            "{{txt_content}}","【正文】"+txt_content).replace(
                                "{{txt_img}}",img_uri)
                )
doc_template.close()

三、使用文心开放API来生成图文

  • 需要先去文心官网申请ak和sk，官网地址：https://wenxin.baidu.com

3.1 第一步：安装文心开放API

# 安装文心开放api接口
!pip install --upgrade wenxin_api

Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: wenxin_api in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (0.1.3)
Requirement already satisfied: tqdm in ./.data/webide/pip/lib/python3.7/site-packages (from wenxin_api) (4.27.0)
Requirement already satisfied: requests>=2.20 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from wenxin_api) (2.24.0)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.20->wenxin_api) (1.25.6)
Requirement already satisfied: chardet<4,>=3.0.2 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.20->wenxin_api) (3.0.4)
Requirement already satisfied: idna<3,>=2.5 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.20->wenxin_api) (2.8)
Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages (from requests>=2.20->wenxin_api) (2019.9.11)

3.2 第二步：配置开放api接口

# 开放api接口配置
import wenxin_api # 可以通过"pip install wenxin-api"命令安装

# 我这里把ak和sk放到了一个文件里，请使用自己申请到的ak和sk
# 文件内只有两行，形如    ak = XXXXX
wenxin_apicfg = "wenxin.baidu.com"    # api 配置文件
with open(wenxin_apicfg) as f:
    i = 0    # 行计数，只读取2行
    for line in f:
        i += 1
        if i>2: break
        lbl,val = line.strip().split("=")
        lbl = lbl.strip()
        val = val.strip()
        if lbl == "ak":
            wenxin_api.ak = val
        elif lbl == "sk":
            wenxin_api.sk = val
        # print(line)
#print(f"wenxin_ak:{wenxin_api.ak}\nwenxin_sk:{wenxin_api.sk}")

3.3 第三步：想一个标题，让AI来创作文章

# 开放API，生成文章
# -*- coding: utf-8 -*
import wenxin_api # 可以通过"pip install wenxin-api"命令安装
from wenxin_api.tasks.composition import Composition
#wenxin_api.ak = ""
#wenxin_api.sk = ""
txt_title = "小猴和桃子"
txt_tail = "小猴爬到树上吃到了桃子"
input_dict = {
    "text": f"题目：{txt_title}\n正文：",
    "seq_len": 512,
    "topp": 0.9,
    "penalty_score": 1.2,
    "min_dec_len": 128,
    "is_unidirectional": 0,
    "task_prompt": "novel",
    "mask_type":"paragraph"
}
rst = Composition.create(**input_dict)
txt_content = rst["result"]
print(txt_content)

2022-12-20 15:44:35,210 - model 1: starts writing
有一个小猴子，喜欢吃桃。你不给它吃，就在地上打滚耍赖，撅着屁股玩儿起了尿盆：“我要喝水！”
又来到了果园里面，很多人都拿出各种奇形怪状的东西向他砸过去。也没见什么稀罕物件，便笑着跑开了；再后退两步看仔细些才发现自己还站在那些成年人跟前呢，赶紧走吧趁这机会能逃掉算好运气啦。可是谁让身体内流淌着猩红鲜血和荷尔蒙汗液捏？

3.4 第四步：让AI来生成摘要

# 开放API，获取摘要
# -*- coding: utf-8 -*
import wenxin_api # 可以通过"pip install wenxin-api"命令安装
from wenxin_api.tasks.summarization import Summarization
#wenxin_api.ak = ""
#wenxin_api.sk = ""

input_dict = {
    "text": f"文章：{txt_content}”\n\n摘要：",
    "seq_len": 55,
    "topp": 0.0,
    "penalty_score": 1.0,
    "min_dec_len": 4,
    "is_unidirectional": 0,
    "task_prompt": "Summarization"
}
rst = Summarization.create(**input_dict)
txt_smr = rst["result"]
print(txt_smr)

2022-12-20 15:45:27,908 - model 1: starts writing
“我们的身体里流淌着猩红鲜血和荷尔蒙汗液。”

3.5 让AI来给文章配图

# 图片显示函数
def show_img(img_path):
    response = requests.get(img_path) #图片地址
    response = response.content
    BytesIOObj = BytesIO()
    BytesIOObj.write(response)
    img = Image.open(BytesIOObj)
    #img = cv2.cvtColor(np.asarray(img), cv2.COLOR_RGB2BGR)
    #img = img.resize((120,120))
    #plt.figure(dpi = 300)
    plt.figure(dpi = 144)
    plt.axis('off')
    plt.imshow(img) 

# 开放API，生成图片
# -*- coding: utf-8 -*
import wenxin_api # 可以通过"pip install wenxin-api"命令安装
from wenxin_api.tasks.text_to_image import TextToImage
#wenxin_api.ak = ""
#wenxin_api.sk = ""

input_txt = f"儿童画,简笔画，插画,《{txt_title},{txt_smr}》"
input_dict = {
    "text": input_txt,
    "style": "油画",
    "num": "4"
}
rst = TextToImage.create(**input_dict)    # 转换成关键字参数传递给接口
# rst dict类型
#print(rst)

# 显示图片
imgUrls = rst["imgUrls"]    # 提取图片地址，list格式

for imurl in imgUrls:
    #print(imurl)
    show_img(imurl)


2022-12-20 15:47:12,890 - model is painting now!, taskId: 11671300, waiting: 3m
2022-12-20 15:47:33,234 - model is painting now!, taskId: 11671300, waiting: 30s

0 - model is painting now!, taskId: 11671300, waiting: 3m
2022-12-20 15:47:33,234 - model is painting now!, taskId: 11671300, waiting: 30s

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

在这里插入图片描述

3.6 简单生成个HTML文档

  • 使用文心开放API返回来的直接就是图片的链接，可以直接用
  • 把生成的doc1.html下载到本地，用浏览器打开即可看到页面
# 生成HTML文档
doc_template = open("./doc.html")
doc_file = "doc1.html"
img_uri = imgUrls[0]
if(os.path.exists(doc_file)):os.remove(doc_file)    # 删除已有的文件
with open(doc_file,"w",encoding='utf-8') as f:
    for line in doc_template:
        f.write(
            line.replace(
                "{{page_title}}",txt_title).replace(
                    "{{txt_title}}", txt_title).replace(
                        "{{txt_smr}}", "【文章摘要】"+txt_smr).replace(
                            "{{txt_content}}","【正文】"+txt_content).replace(
                                "{{txt_img}}",img_uri)
                )
doc_template.close()

四、总结

  • 只需要要给题目，剩下的事情完全交给AI
  • 现在生成的图文还不是很理想
  • 但是随着模型的迭代，也许真会有那么一天，你给孩子买的绘本其实是AI创作的
  • 这个实验项目的最大问题是需要反复调用模型
  • 生成HTML仍然需要自己处理，如果AI能够把这个活儿也给干了，就完美了
AI Studio
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
2022CCF BDCI 大数据平台安全事件检测与分类识别 数据
02-04
标题和描述中提到的"2022CCF BDCI 大数据平台安全事件检测与分类识别 数据"是一项竞赛或研究项目，其中涉及到的关键领域是大数据的安全管理，特别是针对安全事件的检测与分类。CCF（中国计算机学会）BDCI（大数据...
2023 CCF BDCI 竞赛方案汇编
最新发布
08-15
城市人口分析与预测 线上线下全场景生鲜超市库存履约一体化决策 基于TuGraph Analytics的⾼性能图模式匹配算法设计 面向金融场景基准测试的TuGraph-DB查询引擎优化 ...基于TPU平台实现超分辨率重建模型部署
平均1秒生成1篇高分高考作文，飞桨文心大模型是怎么做到的？
AI科技大本营
06-07 2097
6月7日，百度数字人度晓晓在高考语文考试结束后，化身为“数字人考生”，挑战高考作文写作，引发全网热议。
关键词句AI作画
m0_63642362的博客
11-14 567
本项目基于文心大模型，以ERNIE 3.0 文本理解与创作：根据一段句子提取其关键词句，再以 ERNIE-ViLG 文生图：根据关键词句生成图画
揭秘百度文心一言大模型：设计、应用与实战
DevCorner的Pro技术博客
09-07 4826
文心一言大模型是一种基于Transformer结构的深度学习模型，具有1.5 trillion 参数，被设计用来回答各种自然语言问题，提供相关的知识和信息。该模型在大量的文本数据上进行训练，从而具备了强大的语言理解能力。
文心：PPT 制作、数字人主播一键开播等应用场景惊艳到我了，下面给到Prompt工程详细教程应用场景及案例
丨汀、的博客
07-22 915
文心千帆：PPT 制作、数字人主播一键开播等应用场景惊艳到我了，下面给到Prompt工程详细教程应用场景及案例；助力“千帆”推行
pip下载包时出现Requirement already satisfied
weixin_43908008的博客
06-15 1832
在虚拟环境路径的powershell窗口使用pip安装包时，显示Requirement already satisfied: numpy in d:… 解决方法：使用命令格式如下 pip install numpy --target=要下载到的路径名 当出现错误 需在安装过程中关闭文件防护 ...
2019CCF-BDCI大赛 OCR赛题第一名 天晨破晓团队 去水印网络CGAN模型baseline .zip
03-14
【标题】"2019CCF-BDCI大赛 OCR赛题第一名 天晨破晓团队 去水印网络CGAN模型baseline .zip"所包含的知识点主要围绕OCR（Optical Character Recognition，光学字符识别）技术、深度学习模型、去水印技术以及比赛策略...
【2019 CCF BDCI】-关联模型-莽就完事了-说明论文1
08-03
本文主要探讨了在2019年CCF大数据与计算智能大赛中，参赛者马凯欣采用的一种关联模型，即伪孪生网络结构的BERT微调模型，用于计算“技术需求”与“技术成果”项目之间的关联度。该模型旨在解决自然语言处理中的文本...
身份证复印件识别算法源码+项目说明（CCF BDCI参赛项目）.zip
01-28
【资源说明】 1、该资源包括项目的全部源码，下载可以直接使用！ 2、本项目适合作为计算机、数学、电子信息等专业的课程设计、期末大作业和毕设项目，...身份证复印件识别算法源码+项目说明（CCF BDCI参赛项目）.zip
安装python包，报权限错误
qq_15821487的博客
01-03 465
【代码】安装python包，报权限错误。
[机器学习] Yellowbrick使用笔记5-回归可视化
You and Me
07-25 1362
回归模型试图预测连续空间中的目标。回归计分可视化工具显示模型空间中的实例，以便更好地理解模型是如何进行预测的。我们目前已经实施了三种回归评估： 残差图Residuals Plot：绘制期望值与实际值之间的差 预测误差图Prediction Error Plot：在模型空间中绘制期望值与实际值 alpha选择：视觉调整正则化超参数 库克距离Cook’s Distance：描述了单个样本对整个回归模型的影响程度 Estimator score Visualizer包装Scikit Learn estimat
【强化学习】SAC算法
m0_63642362的博客
09-18 3955
强化学习SAC算法+Pendulum的paddle版实现
paddlepaddle高层API训练营第一天——手写数字识别
python_white的博客
02-04 399
0. 导入相关库 import paddle import paddle.vision.transforms as T import numpy as np import matplotlib.pyplot as plt /opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/matplotlib/__init__.py:107: DeprecationWarning: Using or importing the ABCs f
【python问题解决】---- Requirement already satisfied 的解决办法
热门推荐
止于至善
06-02 2万+
1.出现问题 pip install pypiwin32 安装时候产生的错误！ 2.解决办法 2.1 指定安装路径 pip install --target=d:\python\lib\site-packages pypiwin32 到达此步，我的问题解决，能够直接安装成功！ 2.2 加上镜像 pip install -i https://pypi.doubanio.com/simple/ --trusted-host pypi.doubanio.com --target=d:\pyt
模型压缩之剪枝（MLP）
m0_63642362的博客
02-12 2937
你想让你大模型在不掉太多精度的前提下，进一步提升速度嘛，走过路过不要错过，手把手教你实现模型压缩中的剪枝操作。
【Python】读取文件时显示 ‘NoneType‘ object has no attribute ‘shape‘
weixin_46585382的博客
10-19 1565
Python报错解决
【2022 CCF BDCI 文心大模型创意项目】中秋款文心带你轻松搞定MV制作
iterhuiの博客
09-07 1万+
输入mp3歌曲和歌曲lrc文件以及一个首页图，即可生成一个MV！就是这么简单！
『抽丝剥茧』手把手快速上带你开启文心大模型的奇妙冒险
三岁学编程的博客
09-02 2175
文心大模型ERNIE 3.0系列&&ERNIE-ViLG文生图系列使用指南，手把手教学！
CCF BDCI 含金量
09-09
CCF BDCI（中国计算机学会大数据产业专委会大数据竞赛）是由中国计算机学会主办的一项大数据竞赛。它是中国领先的大数据竞赛之一，旨在推动大数据技术在各个领域的应用和创新。 该竞赛的含金量很高，因为它聚集了来自业界和学术界的顶尖专家和团队，提供了实际的大数据问题和挑战。参与者可以通过解决这些问题来展示他们的技术实力和创新能力。获胜者将获得不仅仅是奖金，还有机会与行业领先企业进行深入合作，并且有可能在学术和职业发展方面获得更多机会。 总之，CCF BDCI是一个具有较高含金量的大数据竞赛，对于参与者来说是一个很好的展示和提升自己技术能力的机会。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值