spark on yarn 部署报:java.io.IOException: Resource file:/usr/local/spark-1.6.3-bin-hadoop2.6/lib/spark-assembly-1.6.3-hadoop2.6.0.jar changed on src filesystem (expected 1530607524000, was 1478125561000
解决:spark-env.sh 之前配置
export HADOOP_CONF_DIR=/usr/local/hadoop-2.6.4
export YARN_CONF_DIR=/usr/local/hadoop-2.6.4
发现 HADOOP_CONF_DIR YARN_CONF_DIR 配置路径问题,修改后执行成功如下
export HADOOP_CONF_DIR=/usr/local/hadoop-2.6.4/etc/hadoop
export YARN_CONF_DIR=/usr/local/hadoop-2.6.4/etc/hadoop