去google-research的text-to-text-transfer-transformer仓库,打包下载整个仓库并解压。(本篇流程针对的仓库版本是main分支的e0a69cd)
- cd 到README.md下
- 创虚拟环境 conda create -n t5
- conda activate t5 然后 conda install python==3.10.0
- pip install -e .
- pip install protobuf==3.20.3
- pip install flax
- pip install <jaxlib-0.3.5+cuda11.cudnn82-cp310-none-win_amd64.whl> #自己去下载whl
- pip install jax==0.3.5
- pip install seqio #mT5模型需要这个
- pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
然后就没问题了,博主是cuda11.1,最后整个t5虚拟环境pip list
后长下面这样:
Package Version
---------------------------- ---------------------
absl-py 1.4.0
array-record 0.2.0
asttokens 2.2.1
astunparse 1.6.3
Babel 2.12.1
backcall 0.2.0
cached-property 1.5.2
cachetools 5.3.0
certifi 2023.5.7
charset-normalizer 3.1.0
chex 0.1.7
click 8.1.3
clu 0.0.9
colorama 0.4.6
comm 0.1.3
contextlib2 21.6.0
contourpy 1.0.7
cycler 0.11.0
debugpy 1.6.7
decorator 5.1.1
dm-tree 0.1.8
editdistance 0.6.2
etils 1.2.0
executing 1.2.0
filelock 3.12.0
flatbuffers 1.12
flax 0.3.3
fonttools 4.39.3
fsspec 2023.5.0
future 0.18.3
gast 0.4.0
gin-config 0.5.0
google-auth 2.17.3
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
googleapis-common-protos 1.59.0
grpcio 1.54.0
h5py 3.8.0
huggingface-hub 0.14.1
idna 3.4
immutabledict 2.2.4
importlib-resources 5.12.0
ipykernel 6.23.0
ipython 8.13.2
jax 0.3.5
jaxlib 0.3.5
jedi 0.18.2
Jinja2 3.1.2
joblib 1.2.0
jupyter_client 8.2.0
jupyter_core 5.3.0
keras 2.9.0
Keras-Preprocessing 1.1.2
kiwisolver 1.4.4
libclang 16.0.0
lxml 4.9.2
Markdown 3.4.3
markdown-it-py 2.2.0
MarkupSafe 2.1.2
matplotlib 3.7.1
matplotlib-inline 0.1.6
mdurl 0.1.2
mesh-tensorflow 0.1.21
ml-collections 0.1.1
ml-dtypes 0.1.0
mpmath 1.2.1
msgpack 1.0.5
nest-asyncio 1.5.6
networkx 3.0
nltk 3.8.1
numpy 1.24.3
oauthlib 3.2.2
opt-einsum 3.3.0
optax 0.1.5
orbax-checkpoint 0.2.2
packaging 23.1
pandas 1.5.3
parso 0.8.3
pickleshare 0.7.5
Pillow 9.5.0
pip 23.0.1
platformdirs 3.5.0
portalocker 2.7.0
promise 2.3
prompt-toolkit 3.0.38
protobuf 3.20.3
psutil 5.9.5
pure-eval 0.2.2
pyasn1 0.5.0
pyasn1-modules 0.3.0
pyglove 0.3.0
Pygments 2.15.1
pyparsing 3.0.9
python-dateutil 2.8.2
pytz 2023.3
pywin32 306
PyYAML 6.0
pyzmq 25.0.2
regex 2023.5.5
requests 2.30.0
requests-oauthlib 1.3.1
rich 13.3.5
rouge-score 0.1.2
rsa 4.9
sacrebleu 2.3.1
scikit-learn 1.2.2
scipy 1.10.1
sentencepiece 0.1.99
seqio 0.0.16
seqio-nightly 0.0.7.dev20220722
setuptools 66.0.0
six 1.16.0
stack-data 0.6.2
sympy 1.11.1
tabulate 0.9.0
tensorboard 2.9.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorflow 2.9.0
tensorflow-datasets 4.9.2
tensorflow-estimator 2.9.0
tensorflow-hub 0.13.0
tensorflow-io-gcs-filesystem 0.31.0
tensorflow-metadata 1.13.1
tensorflow-text 2.9.0
tensorstore 0.1.36
termcolor 2.3.0
tfds-nightly 4.9.2.dev202305090044
threadpoolctl 3.1.0
tokenizers 0.13.3
toml 0.10.2
toolz 0.12.0
torch 2.0.1+cu117
torchaudio 2.0.2+cu117
torchvision 0.15.2+cu117
tornado 6.3.1
tqdm 4.65.0
traitlets 5.9.0
transformers 4.28.1
typing_extensions 4.5.0
urllib3 2.0.2
wcwidth 0.2.6
Werkzeug 2.3.4
wheel 0.38.4
wrapt 1.15.0
zipp 3.15.0