python2.7安装tensorflow_centos7下安装部署tensorflow GPU 版本

系统环境：centos7

1. 安装 Python 2.7

# yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gccgcc-c++make

# download and extract Python 2.7

su hdfs

cd ~/Downloads

curl -O https://www.python.org/ftp/python/2.7.12/Python-2.7.12.tgz

tar -xvf Python-2.7.12.tgz

# compile into local PYTHON_ROOT

# export PYTHON_ROOT=~/Python

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

pushd Python-2.7.12

./configure --prefix="${PYTHON_ROOT}" --enable-unicode=ucs4

make

make install

popd

# install pip

pushd "${PYTHON_ROOT}"

bin/python get-pip.py

rm -rf get-pip.py

# 安装依赖库

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

${PYTHON_ROOT}/bin/pipinstall yarn-api-client

${PYTHON_ROOT}/bin/pipinstalluniout

${PYTHON_ROOT}/bin/pipinstallnumpy

${PYTHON_ROOT}/bin/pipinstallpydoop

# 打包python_gpu

export PYTHON_ROOT=/var/lib/hadoop-hdfs/TensorFlowOnSpark-Work/Python_gpu

pushd "${PYTHON_ROOT}"

zip -r Python_gpu.zip *

2. 在 Python 2.7 中安装tensorflow GPU

# 安装显卡驱动和cuda和cudda

参考文档

# 安装nvidia-modprobe

yum -y install nvidia-modprobe

#查看gpu信息

export PATH="$PATH:/usr/local/cuda-8.0/bin"

export LD_LIBRARY_PATH="/usr/local/cuda-8.0/lib64"

nvidia-smi

能看到这个信息说明gpu已经安装配置成功

# 安装tensorflow

su hdfs

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

${PYTHON_ROOT}/bin/pip install tensorflow-gpu

# 安装keras

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

${PYTHON_ROOT}/bin/pip install keras

# 验证一 tensorflow

su hdfs

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

export PATH="$PATH:/usr/local/cuda-8.0/bin"

export LD_LIBRARY_PATH="/usr/local/cuda-8.0/lib64"

${PYTHON_ROOT}/bin/python

import tensorflow as tf

hello = tf.constant('Hello, TensorFlow!')

sess = tf.Session()

print (sess.run(hello))

a = tf.constant([1.0, 2.0, 3.0, 4.0, 5.0, 6.0], shape=[2, 3], name='a')

b = tf.constant([1.0, 2.0, 3.0, 4.0, 5.0, 6.0], shape=[3, 2], name='b')

c = tf.matmul(a, b)

sess = tf.Session(config=tf.ConfigProto(log_device_placement=True))

print(sess.run(c))

# 验证二 tensorflow

su hdfs

cd /var/lib/hadoop-hdfs/Downloads/tensorflow/tensorflow/examples/tutorials/mnist

export PYTHON_ROOT=~/TensorFlowOnSpark-Work/Python_gpu

export PATH="$PATH:/usr/local/cuda-8.0/bin"

export LD_LIBRARY_PATH="/usr/local/cuda-8.0/lib64"

${PYTHON_ROOT}/bin/python mnist_deep.py

已经可以看到 gpu的进程和负载了