Ubuntu上部署TensorFlow服务

一、Docker安装：https://docs.docker.com/install/linux/docker-ce/ubuntu

sudo apt-get remove docker docker-engine docker.io

sudo apt-get update

sudo apt-get install apt-transport-https ca-certificates curl software-properties-common

curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -

sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"

sudo apt-get update

sudo apt-get install docker-ce

sudo docker run hello-world

二、TensorFlow服务安装：https://www.tensorflow.org/serving/docker#running_a_gpu_serving_image

sudo apt-get install git

sudo docker pull tensorflow/serving

mkdir -p /tmp/tfserving

cd /tmp/tfserving

git clone https://github.com/tensorflow/serving

sudo docker run -p 8501:8501 --mount type=bind,source=/tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_cpu,target=/models/m -e MODEL_NAME=m -t tensorflow/serving &

curl -d '{"instances": [1.0, 2.0, 5.0]}'  -X POST http://localhost:8501/v1/models/m:predict