Spark安装

1．官网地址

 http://spark.apache.org/

2．文档查看地址

https://spark.apache.org/docs/2.1.1/

3．下载地址

    https://spark.apache.org/downloads.html

页面的最下方可以下载历史版本与最新版本的spark，如图：

点击链接进去后会有很多个版本可以选择

选择自己对应的版本进行下载即可

 

4.上传并解压spark安装包

     通过客户端工具将下载好的spark上传到linux相应的地方就可以。

     如果使用wget的方式直接下载到linux系统的朋友，就不用有上传这一步操作了。

    [atguigu@hadoop102 sorfware]$ tar -zxvf spark-2.1.1-bin-hadoop2.7.tgz -C /opt/module/

    [atguigu@hadoop102 module]$ mv spark-2.1.1-bin-hadoop2.7 spark

 

5.安装好spark后，进行验证是否安装成功

[atguigu@hadoop102 spark]$ bin/spark-shell
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
18/09/29 08:50:52 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/09/29 08:50:58 WARN ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Spark context Web UI available at http://192.168.9.102:4040
Spark context available as 'sc' (master = local[*], app id = local-1538182253312).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.1.1
      /_/
         
Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_144)
Type in expressions to have them evaluated.
Type :help for more information.

scala>