BigDL安装和使用指导

 

0BigDL Building Guide

0.1 Create Ubuntu VM

Flavor:4vCPU 8GBMem 40GBDisk

0.2 Install Anaconda

Download latest version of Anaconda from:

https://www.anaconda.com/download/#linux

Note: choose latest version

 

Upload to the Ubuntu VM insides, andexecute the command below to install:

bash /opt/Anaconda/Anaconda2-5.0.1-Linux-x86_64.sh

 

Check version:

anaconda --version

anaconda Command line client (version1.6.5)

 

0.3 Install Java-JDK

conda install -c bioconda java-jdk

 

Check java version:

java -version

openjdk version "1.8.0_92"

OpenJDK Runtime Environment (Zulu8.15.0.1-linux64) (build 1.8.0_92-b15)

OpenJDK 64-Bit Server VM (Zulu8.15.0.1-linux64) (build 25.92-b15, mixed mode)

 

Edit /root/.bashrc, add the following javaenvironment variables:

exportJAVA_HOME=/opt/anaconda2/pkgs/java-jdk-8.0.92-1

exportPATH="/opt/anaconda2/bin:$PATH:$JAVA_HOME/bin"

0.4 Install Maven

Download Maven binary package from website:

https://maven.apache.org/download.cgi

And unzip it, and then edit /root/.bashrcby adding the following variables:

 

0.5 Install Scala

conda install -c bioconda scala

Note: chooselatest version in conda

 

0.6 Install Spark

conda install -c conda-forge pyspark=2.1.0

 

Check spark:

spark-shell --master local[2]

0.7 Install MXNet

conda install -c anaconda mxnet

 

Check by the following code:

root@bigdl:/opt/anaconda2# python

Python 2.7.14 |Anaconda custom (64-bit)| (default,Oct 16 2017, 17:29:19)

[GCC 7.2.0] on linux2

Type "help", "copyright","credits" or "license" for more information.

>>> import mxnet as mx