一、问题
下载spark-2.0.0-bin-hadoop2.7.tgz 后,在C:\spark\bin 运行spark-shell.cmd 时, 报错
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)
二、解决办法
1. 下载 winutils.exe 放到 c:\hadoop\bin
2. 设置环境变量
HADOOP_HOME=c:\hadoop
PATH=%HADOOP_HOME%\bin
3. 在C:\spark\bin 右键 以管理员运行 spark-shell.cmd