版本:
系统版本:ubuntu 1804
jdk:openjdk 11.0.7
spark-3.0.0-bin-hadoop2.7.tgz
步骤:
1 的下载安装包:
wget https://mirrors.tuna.tsinghua.edu.cn/apache/spark/spark-3.0.0/spark-3.0.0-bin-hadoop2.7.tgz
2 解压并建立软连接:
# 到项目目录
tar -xzvf spark-3.0.0-bin-hadoop2.7.tgz
mkdir /usr/local/program/spark
mv spark-3.0.0-bin-hadoop2.7 /usr/local/program/spark
cd /usr/local/program/spark/
ln -s spark-3.0.0-bin-hadoop2.7 default
3 更新环境变量:
vi /etc/profile
SPARK_HOME=/usr/local/program/spark/default
export PATH=$SPARK_HOME/bin:$PATH
source /etc/profile
```
4 检验
```bash
spark-shell