Win10+Hadoop2.7.5的环境配置参考如下链接:
https://blog.csdn.net/xiligey1/article/details/79728152
Java和Spark安装好了之后,就只剩下Scala和Spark了
版本:
- Scala2.11(Spark2.3与Scala2.11适配)
- Spark2.3
1.官网下载scala2.11太慢,链接: https://pan.baidu.com/s/1ibWaNLkghYEz8FFRN4MG-w 密码: 4126。下载完双击exe文件安装即可
2.官网下载Spark2.3 http://spark.apache.org/downloads.html,解压至安装目录
3.新建环境变量SPARK_HOME,值为spark安装目录
4.将%SPARK_HOME%\bin添加至环境变量path
5.终端输入spark-shell或pyspark或sparkR,能成功打开则安装成功