1.spark环境搭建

 Anaconda: https://www.anaconda.com/products/individual-d
JDK:https://docs.aws.amazon.com/zh_cn/corretto/latest/corretto-8-ug/downloads-list.html
Hadoop:https://archive.apache.org/dist/hadoop/common/ Spark:https://spark.apache.org/downloads.html
winutils:https://github.com/steveloughran/winutils
mysql-connector-java-8.0.25: https://downloads.mysql.com/archives/c-j/

注意：在解压时Hadoop是要用管理员权限解压

# 此电脑-属性-高级系统设置-高级-环境变量-系统变量-新建

JAVA_HOME:D:\BigData\jdk
HADOOP_HOME:D:\BigData\hadoop

SPARK_HOME: D:\BigData\spark

%JAVA_HOME%\bin
%JAVA_HOME%\jre\bin

%HADOOP_HOME%\bin

%HADOOP_HOME%\sbin

%SPARK_HOME%\bin

%SPARK_HOME%\sbin

 

测试：

cmd 

java -version

hadoop

spark-shell