colab下百度ERNIE的安装

安装paddlepaddle

安装命令

!python -m pip install paddlepaddle-gpu==2.0.1.post100 -f https://paddlepaddle.org.cn/whl/mkl/stable.html

安装paddle-ernie

安装命令

!pip install paddle-ernie

测试安装是否成功

下载模型相关的文件

!wget https://ernie-github.cdn.bcebos.com/model-ernie1.0.1.tar.gz

解压

!tar -zxvf model-ernie1.0.1.tar.gz

得到：

测试

import numpy as np
import paddle as P
from ernie.tokenizing_ernie import ErnieTokenizer
from ernie.modeling_ernie import ErnieModel
path = '/content/drive/MyDrive/ERNIE_test/model/'
model = ErnieModel.from_pretrained(path)    # Try to get pretrained model from server, make sure you have network connection
model.eval()
tokenizer = ErnieTokenizer.from_pretrained(path)

ids, _ = tokenizer.encode('hello world')
ids = P.to_tensor(np.expand_dims(ids, 0))  # insert extra `batch` dimension
pooled, encoded = model(ids)                 # eager execution
print(pooled.numpy().shape)                        # convert  results to numpy

结果：

2021-03-18 09:04:52,504 - INFO - pretrain dir /content/drive/MyDrive/ERNIE_test/model/ not in {'ernie-1.0': 'https://ernie-github.cdn.bcebos.com/model-ernie1.0.1.tar.gz', 'ernie-2.0-en': 'https://ernie-github.cdn.bcebos.com/model-ernie2.0-en.1.tar.gz', 'ernie-2.0-large-en': 'https://ernie-github.cdn.bcebos.com/model-ernie2.0-large-en.1.tar.gz', 'ernie-tiny': 'https://ernie-github.cdn.bcebos.com/model-ernie_tiny.1.tar.gz'}, read from local
2021-03-18 09:04:52,572 - INFO - loading pretrained model from /content/drive/MyDrive/ERNIE_test/model
2021-03-18 09:04:56,376 - INFO - pretrain dir /content/drive/MyDrive/ERNIE_test/model/ not in {'ernie-1.0': 'https://ernie-github.cdn.bcebos.com/model-ernie1.0.1.tar.gz', 'ernie-2.0-en': 'https://ernie-github.cdn.bcebos.com/model-ernie2.0-en.1.tar.gz', 'ernie-2.0-large-en': 'https://ernie-github.cdn.bcebos.com/model-ernie2.0-large-en.1.tar.gz', 'ernie-tiny': 'https://ernie-github.cdn.bcebos.com/model-ernie_tiny.1.tar.gz', 'ernie-gen-base-en': 'https://ernie-github.cdn.bcebos.com/model-ernie-gen-base-en.1.tar.gz', 'ernie-gen-large-en': 'https://ernie-github.cdn.bcebos.com/model-ernie-gen-large-en.1.tar.gz'}, read from local
(1, 768)