spark2.4.0安装
安装步骤
本文是spark2.4.0基于scala2.10.6的spark安装!
spark下载链接:http://mirrors.shu.edu.cn/apache/
scala下载链接:https://www.scala-lang.org/download/2.10.6.html
scala解压复制到所有节点
[hadoop@master ~]$ tar -zxvf scala-2.10.6.tgz
[hadoop@master ~]$ scp -r /home/hadoop/scala-2.10.6/ slave01:/home/hadoop/
[hadoop@master ~]$ scp -r /home/hadoop/scala-2.10.6/ slave02:/home/hadoop/
spark解压
[hadoop@master ~]$ tar -zxvf spark-2.4.0-bin-hadoop2.6.tgz
更改spark名字(个人习惯)
[hadoop@master ~]$ mv spark-2.4.0-bin-hadoop2.6 spark-2.4.0