Mac搭建第一个spark项目

1.log4j下载安装
https://www.yiibai.com/log4j/log4j_installation.html

2.hadoop下载安装
hadoop下载地址：
http://www.apache.org/dyn/closer.cgi/hadoop/core/

https://www.jianshu.com/p/1023dc22596b
https://zhuanlan.zhihu.com/p/33117305

运行：

hadoop namenode -format

报错：/Users/liu/Downloads/spark/hadoop-3.2.0/etc/hadoop/hadoop-env.sh: line 57: export: `/Library/Java/JavaVirtualMachines/jdk1.8.0_221.jdk/Contents/Home’: not a valid identifier
解决： hadoop-env.sh中的“=”两侧删除空格

报错：WARNING: Use of this script to execute namenode is deprecated.
解决 ： 将hadoop namenode -format 换为hdfs namenode -format

报错：Attempting to operate on hdfs namenode as root
https://blog.csdn.net/lglglgl/article/details/80553828

报错：ERROR: namenode can only be executed by root.
用sudo + hdfs namenode -format

报错：hadoop-functions.sh: line 398: syntax error near unexpected token `<’
http://quabr.com/52396939/hadoop-start-dfs-sh-throwing-syntax-errors
暂时还未解决

3.spark下载安装
https://www.cnblogs.com/blog5277/p/8567337.html