写在前面:
情况说明:
- TensorFlowOnYARN在技术调研的过程中遇到问题,根据能够找到的资料与现实情况分析,调研工作转向Linkedin's TonY方向;
- TensorFlowOnYARN在2017年4月18日做了最后一次更新提交,之后作者不再维护,上述编译过程中出现的错误,作者已经给出如下答复;
下载镜像:
docker pull tensorflow/tensorflow:nightly-devel
启动镜像:
- docker run -it -p 8888:8888 tensorflow/tensorflow:nightly-devel;
- docker exec -it CONTAINER_ID /bin/bash,登录镜像运行环境;
升级组件:
- apt-get update
- apt-get install maven
TensorFlow编译:
- ./configure
- bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package
- ./bazel-bin/tensorflow/tools/pip_package/build_pip_package /mnt
- pip install /mnt/tensorflow-1.12.0rc0-cp27-cp27mu-linux_x86_64.whl
- cd /tmp
- python -c "import tensorflow as tf; print(tf.__version__)"
编译问题:
(图片丢失)
[INFO] --------------------< org.hdl:tensorflow-yarn-dist >--------------------
[INFO] Building TensorFlow on YARN Distribution 0.1.0-SNAPSHOT [5/5]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO]
[INFO] --- maven-assembly-plugin:2.2-beta-5:single (dist) @ tensorflow-yarn-dist ---
[INFO] Reading assembly descriptor: src/assembly/bin.xml
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for TensorFlowOnYARN 0.1.0-SNAPSHOT:
[INFO]
[INFO] TensorFlowOnYARN ................................... SUCCESS [ 0.002 s]
[INFO] JNI bridge to TensorFlow ........................... SUCCESS [ 11.680 s]
[INFO] TensorFlow source codes ............................ SUCCESS [ 6.741 s]
[INFO] TensorFlow on YARN Application ..................... SUCCESS [ 2.215 s]
[INFO] TensorFlow on YARN Distribution .................... FAILURE [ 0.033 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.863 s
[INFO] Finished at: 2019-10-31T09:19:03Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.2-beta-5:single (dist) on project tensorflow-yarn-dist: Failed to create assembly: Error adding file to archive: /root/TensorFlowOnYARN/tensorflow-parent/tensorflow-yarn-dist/../tensorflow-native/tensorflow/bazel-bin/tensorflow/core/distributed_runtime/rpc/libbridge.so isn't a file. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] MojoExecutionException - Apache Maven - Apache Software Foundation
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :tensorflow-yarn-dist