spark: ERROR Shell: Failed to locate the winutils binary in the hadoop binary path

一、问题

 

下载spark-2.0.0-bin-hadoop2.7.tgz   后，在C:\spark\bin 运行spark-shell.cmd 时,  报错

 

 

ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
  at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)
  at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)
  at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)
  at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)

 

二、解决办法

 

 

 

1.    下载 winutils.exe      放到  c:\hadoop\bin

 

2.    设置环境变量

 

 

HADOOP_HOME=c:\hadoop

PATH=%HADOOP_HOME%\bin

 

 

3.  在C:\spark\bin    右键 以管理员运行 spark-shell.cmd