MAC OS下编译tensorflow 2.4.1 - 支持GPU CUDA 10.1和AVX2 FMA

十一心先生

于 2021-02-19 14:42:44 发布

阅读量1.5k

点赞数 1

分类专栏： Computer Vision 文章标签： tensorflow macos cuda 深度学习 python

本文链接：https://blog.csdn.net/evanwoods/article/details/113858208

版权

Computer Vision 专栏收录该内容

5 篇文章 0 订阅

订阅专栏

步骤

1. 为什么要自己编译tensorflow?
2. 编译环境
- 2.1 安装所需软件
3. 编译步骤
4. 总结
- 4.1 参考

1. 为什么要自己编译tensorflow?

tensorflow官方不再提供macos的GPU安装包，因为Nvidia也不再提供macos下的显卡驱动了。而官方的CPU安装包也没有针对AVX2, FMA等指令集优化，跑模型会出现：

Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA

据说启用AVX2, FMA等指令集可以在CNN模型上提速约40%。

查看CPU支持的指令集的命令为：

sysctl -a | grep "machdep.cpu.*features:"

通常编译tensorflow有以下2点原因：

安装了黑苹果并插了显卡或MAC插了外置显卡，希望利用上GPU。
CPU环境下希望利用AVX2, FMA等进行加速。

2. 编译环境

笔者使用的是一台PC，CPU为Intel i5，GPU为GTX 1050Ti，系统安装了黑苹果。由于Nvidia的驱动最高只能支持到OSX 10.13，所以系统只能安装High Sierra。

注意：

要驱动GPU只能安装High Sierra;

只编译优化CPU包可以安装新版本的macos。

2.1 安装所需软件

显卡驱动和CUDA 10.1
这里提供了mac下安装Nvidia驱动的快捷方式：https://github.com/Benjamin-Dobell/nvidia-update
只需要执行：

bash <(curl -s https://raw.githubusercontent.com/Benjamin-Dobell/nvidia-update/master/nvidia-update.sh)

安装完确保系统信息显示正确。
System Info

到nvidia官网下载CUDA 10.1的osx安装包并安装。安装完System Preferences下会多出一项“CUDA”：
CUDA Info
到nvidia官网下载cudnn 7.6包，并解压复制文件到CUDA安装目录。

Xcode 10.1
从apple developer官网或搜索百度云下载安装。
python 3
下载并安装：https://www.python.org/ftp/python/3.7.9/python-3.7.9-macosx10.9.pkg
bazel 3.7.2
这是编译tensorflow 2.4要求的最低版本。
下载可执行文件：https://github.com/bazelbuild/bazel/releases/download/3.7.2/bazel-3.7.2-darwin-x86_64
然后链接一下到/usr/local/bin，测试一下能否输出版本号：

chmod +x ~/Downloads/bazel-3.7.2-darwin-x86_64
ln -s ~/Downloads/bazel-3.7.2-darwin-x86_64 /usr/local/bin/bazel
bazel --version

3. 编译步骤

3.1 安装python包

pip3 install -U pip numpy wheel
pip3 install -U keras_preprocessing --no-deps

3.2 克隆代码

git clone https://github.com/tensorflow/tensorflow
cd tensorflow
git checkout v2.4.1

3.3 修改代码

有几个文件的代码需要修改一下才能在macos下编译通过。请到github项目下载patch文件，然后执行：

git am 2.4.1.patch

3.4 配置编译选项

如果编译GPU包，注意在CUDA Support选项输入y，否则选N。

./configure
You have bazel 3.7.2 installed.
Please specify the location of python. [Default is /usr/local/bin/python3]: 


Found possible Python library paths:
  /Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages
Please input the desired Python library path to use.  Default is [/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages]

Do you wish to build TensorFlow with ROCm support? [y/N]: N
No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Found CUDA 10.1 in:
    /usr/local/cuda/lib
    /Developer/NVIDIA/CUDA-10.1/include
Found cuDNN 7 in:
    /usr/local/cuda/lib
    /Developer/NVIDIA/CUDA-10.1/include


Please specify a list of comma-separated CUDA compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus. Each capability can be specified as "x.y" or "compute_xy" to include both virtual and binary GPU code, or as "sm_xy" to only include the binary code.
Please note that each additional compute capability significantly increases your build time and binary size, and that TensorFlow only supports compute capabilities >= 3.5 [Default is: 3.5,7.0]: 3.0,3.5,5.0,6.1,7.0


WARNING: XLA does not support CUDA compute capabilities lower than 3.5. Disable XLA when running on older GPUs.
Do you want to use clang as CUDA compiler? [y/N]: N
nvcc will be used as CUDA compiler.

Please specify which gcc should be used by nvcc as the host compiler. [Default is /usr/bin/gcc]: 


Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -Wno-sign-compare]: 


Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: N
Not configuring the WORKSPACE for Android builds.

Do you wish to build TensorFlow with iOS support? [y/N]: N
No iOS support will be enabled for TensorFlow.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
    --config=mkl             # Build with MKL support.
    --config=mkl_aarch64     # Build with oneDNN support for Aarch64.
    --config=monolithic      # Config for mostly static monolithic build.
    --config=ngraph          # Build with Intel nGraph support.
    --config=numa            # Build with NUMA support.
    --config=dynamic_kernels    # (Experimental) Build kernels into separate shared objects.
    --config=v2              # Build TensorFlow 2.x instead of 1.x.
Preconfigured Bazel build configs to DISABLE default on features:
    --config=noaws           # Disable AWS S3 filesystem support.
    --config=nogcp           # Disable GCP support.
    --config=nohdfs          # Disable HDFS support.
    --config=nonccl          # Disable NVIDIA NCCL support.
Configuration finished

3.5 编译代码

使用以下命令来编译：

bazel build -c opt --copt=-mavx --copt=-mavx2 --copt=-mfma --copt=-msse4.2 //tensorflow/tools/pip_package:build_pip_package

如果遇到下面的错误，则需要把bazel-tensorflow/external/com_google_absl/absl/container/internal/compressed_tuple.h中的那2个有问题的函数注释掉：

external/com_google_absl/absl/container/internal/compressed_tuple.h:171:53: error: use 'template' keyword to treat 'Storage' as a dependent template name
return (std::move(*this).internal_compressed_tuple::Storage< CompressedTuple, I> ::get()); 
                                                    ^
                                                    template 
external/com_google_absl/absl/container/internal/compressed_tuple.h:177:54: error: use 'template' keyword to treat 'Storage' as a dependent template name
return (absl::move(*this).internal_compressed_tuple::Storage< CompressedTuple, I> ::get()); 
                                                     ^
                                                     template 
2 errors generated.

编译过程很漫长，可能需要8个小时，如果没有错误，结束时会输出：

...
Target //tensorflow/tools/pip_package:build_pip_package up-to-date:
  bazel-bin/tensorflow/tools/pip_package/build_pip_package
INFO: Elapsed time: 17902.809s, Critical Path: 684.61s
INFO: 7578 processes: 41 internal, 7537 local.
INFO: Build completed successfully, 7578 total actions
INFO: Build completed successfully, 7578 total actions

3.6 打包安装包

./bazel-bin/tensorflow/tools/pip_package/build_pip_package /tmp/tensorflow_pkg

会在/tmp/tensorflow_pkg下生成wheel安装包，如：tensorflow-2.4.1-cp37-cp37m-macosx_10_13_x86_64.whl

3.7 安装编译出来的安装包

pip3 install /tmp/tensorflow_pkg/tensorflow-2.4.1-cp37-cp37m-macosx_10_13_x86_64.whl

3.8 运行测试

随便运行一个模型可以看到类似下面的输出，则说明运行正常：

2021-02-19 12:27:55.699299: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.10.1.dylib
2021-02-19 12:27:57.935779: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-02-19 12:27:57.959578: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.dylib
2021-02-19 12:27:57.984405: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:902] OS X does not support NUMA - returning NUMA node zero
2021-02-19 12:27:57.984958: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:01:00.0 name: GeForce GTX 1050 Ti computeCapability: 6.1
coreClock: 1.392GHz coreCount: 6 deviceMemorySize: 4.00GiB deviceMemoryBandwidth: 104.43GiB/s
2021-02-19 12:27:57.985295: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.10.1.dylib
2021-02-19 12:27:58.067490: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.10.dylib
2021-02-19 12:27:58.067768: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.10.dylib
2021-02-19 12:27:58.121329: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.10.dylib
2021-02-19 12:27:58.143269: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.10.dylib
2021-02-19 12:27:58.234257: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.10.dylib
2021-02-19 12:27:58.288708: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.10.dylib
2021-02-19 12:27:58.372196: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.7.dylib
2021-02-19 12:27:58.372467: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:902] OS X does not support NUMA - returning NUMA node zero
2021-02-19 12:27:58.372987: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:902] OS X does not support NUMA - returning NUMA node zero
2021-02-19 12:27:58.373252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
...

如果出现下面的错误，则需要升级一下numpy的版本：

F tensorflow/python/lib/core/bfloat16.cc:714] Check failed: PyBfloat16_Type.tp_base != nullptr 
Abort trap: 6

pip3 install -U numpy

4. 总结

祝编译顺利！如果遇到什么问题，欢迎与我联系！项目的github地址为：https://github.com/evan-wu/tensorflow-macosx-build。欢迎关注、点赞、加🌟。

4.1 参考

官方编译文档：https://www.tensorflow.org/install/source#macos_1
已有的CPU优化包：https://github.com/lakshayg/tensorflow-build
提供了到tensorflow 2.2的代码patch：https://github.com/TomHeaven/tensorflow-osx-build

十一心先生

关注

1
点赞
踩
1

收藏

觉得还不错? 一键收藏
5
评论
MAC OS下编译tensorflow 2.4.1 - 支持GPU CUDA 10.1和AVX2 FMA

步骤1. 为什么要自己编译tensorflow?2. 编译环境2.1 安装所需软件3. 编译步骤3.1 安装python包3.2 克隆代码3.3 修改代码3.4 配置编译选项3.5 编译代码3.6 打包安装包3.7 安装编译出来的安装包3.8 运行测试4. 总结4.1 参考1. 为什么要自己编译tensorflow?tensorflow官方不再提供macos的GPU安装包，因为Nvidia也不再提供macos下的显卡驱动了。而官方的CPU安装包也没有针对AVX2, FMA等指令集优化，跑模型会出现：Y
复制链接

扫一扫