分布式训练遇到的问题

AllReduce架构

import tensorflow_datasets as tfds
datasets, info = tfds.load(name='mnist', with_info=True, as_supervised=True)

All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with "Not found: Could not locate the credentials file.". Retrieving token from GCE failed with "Failed precondition: Error executing an HTTP request: libcurl code 6 meaning 'Couldn't resolve host name', error details: Couldn't resolve host 'metadata'".

解：对tensorflow-datasets降级到2.1.0即可

pip3 uninstall tensorflow-datasets

pip3 install tensorflow-datasets==2.1.0 -i https://pypi.tuna.tsinghua.edu.cn/simple