Spark源码编译:
dev/目录下执行make-distribution.sh
./dev/make-distribution.sh --name 2.6.0-cdh5.7.0 --tgz Pyarn -Phadoop-2.6
-Phive -Phive-thriftserver -Dhadoop.version-2.6.0-cdh5.7.0
python3源码安装编译:
下载python3的源码:https://www.python.org/downloads/,存放到指定个位置例如:source文件夹
解压文件:tar -zvxf Python-3.6.5.tgz -C ~/software/python3
依赖的包:在该目录下执行yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel
开始编译:在该目录下执行./configure --prefix=/home/hadoop/app/python3.5
安装:在该目录下执行make & make install
配置系统环境变量:vi ~/.bash_profile export=/home/hadoop/app/python3/bin:$PATH