hibench安装可能出现的错误

Found binding in [jar:file:/home/wk/sd_spark/spark/spark-bodropout-test/spark/jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/wk/sd_hadoop/spark/spark-bodropout-test/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]

jar包冲突，删掉一个

mvn -Phadoopbench -Psparkbench -Dspark=2.2 -Dscala=2.11 clean package

编译hibench，我版本spark2.2 scala 2.11 刚好
hibench出错的原因通常是版本不对，打开spark-shell看版本，对应好，还有就是虚拟内存溢出的问题，在上一篇博客，记得同步集群

连接不到master7077 可以用netstat -an|grep 7077查看端口号，原因是没有开启master，进入spark/sbin/start-all.sh
hdfs web页面打不开关防火墙： systemctl stop firewalld.service