bigflow 在centos7下的使用

编译步骤：root权限顺畅些。

git clone https://github.com/baidu/bigflow.git
cd bigflow/build_support
sh build_deps.sh
source ./environment
mkdir -p ../build && cd ../build && cmake ..
make
make release

安装过程问题多多
 

Connecting to github.com (github.com)|13.250.177.223|:443... connected.
OpenSSL: error:1409442E:SSL routines:ssl3_read_bytes:tlsv1 alert protocol version
Unable to establish SSL connection.
make[2]: *** [extern_protobuf-prefix/src/extern_protobuf-stamp/extern_protobuf-download] Error 4
make[1]: *** [CMakeFiles/extern_protobuf.dir/all] Error 2
make: *** [all] Error 2

类似问题是 版本不对tls不对，在make文件中手动更改 加入 --secure-protocol=TLSv1_2
wget --secure-protocol=TLSv1_2  https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz

安装包有,真是跪了，安装好几天，各种问题。换种思路，不直接编译

下载安装包https://github.com/baidu/bigflow/releases，设置好依赖的环境变量。

# .bash_profile

# Get the aliases and functions
if [ -f ~/.bashrc ]; then
    . ~/.bashrc
fi

# User specific environment and startup programs

export PATH=/home/hadoop/bigflow/build_support/deps/cmake-3.10.0-Linux-x86_64/bin/:$PATH
#export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.151-1.b12.el7_4.x86_64
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk
export JRE_HOME=$JAVA_HOME/jre
export CLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/deps.jar:$JRE_HOME/lib
export MAVEN_HOME=/home/hadoop/bigflow/build_support/deps/apache-maven-3.5.0
export HADOOP_HOME=/home/hadoop/bigflow/build_support/deps/hadoop-2.6.5
export SPARK_HOME=/home/hadoop/bigflow/build_support/deps/spark-2.1.0-bin-hadoop2.7
export BIG_FLOW=/home/hadoop/bigflow_python/bigflow

PROTO_HOME=/home/hadoop/bigflow/build_support/protoc
PATH=$PATH:$HOME/.local/bin:$HOME/bin:$JAVA_HOME/bin:$JRE_HOME/bin:$PROTO_HOME/bin:${MAVEN_HOME}/bin:$BIG_FLOW/bin/pyrun:$HADOOP_HOME/bin

export PATH

 

最后 bigflow/bin/pyrun