环境信息
ubuntu
hadoop 3.3.1
spark 3.2.1
jdk 1.8.231
scala 2.12.15
问题描述
已经安装好单节点hadoop,并验证成功,可以访问,http://192.168.58.129:9870
1、安装spark单节点,启动报错,提示找不到一些class,如下
Caused by: java.lang.ClassNotFoundException: org.slf4j.Logger
下载log4j-1.2.17.jar
和 slf4j-api-1.7.36.jar
到spark里面的 jars 目录
2、增加jar包后,还是报错,如下所示
hadoop@ubuntu:/usr/local/spark/sbin$ ./start-all.sh
starting org.apache.spark.deploy.master.Master, logging to /usr/local/spark/logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-ubuntu.out
failed to launch: nice -n 0 /usr/local/spark/bin/spark-class org.apache.spark.deploy.master.Master --host ubuntu --port 7077 --webui-port 8080
Spark Command: /usr/lib/jvm/jdk1.8.0_231/bin/java -cp /usr/local/spark/conf/:/usr/l