CentOS上部署TensorFlow服务

一、Docker安装：https://docs.docker.com/install/linux/docker-ce/centos/#install-docker-ce-1

sudo yum remove docker docker-client docker-client-latest docker-common docker-latest docker-latest-logrotate docker-logrotate docker-selinux docker-engine-selinux docker-engine

sudo yum install -y yum-utils device-mapper-persistent-data lvm2

sudo yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo

sudo yum install docker-ce

sudo systemctl start docker

sudo docker run hello-world

二、TensorFlow服务安装：https://www.tensorflow.org/serving/docker#running_a_gpu_serving_image

yum install git

docker pull tensorflow/serving

mkdir -p /tmp/tfserving

cd /tmp/tfserving

git clone https://github.com/tensorflow/serving

sudo docker run -p 8501:8501 --mount type=bind,source=/tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu,target=/models/m -e MODEL_NAME=m -t tensorflow/serving &

curl -d '{"instances": [1.0, 2.0, 5.0]}'  -X POST http://localhost:8501/v1/models/m:predict