在我的win7 idea环境下,运行spark程序,报错:
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
看报错信息,应该是在hadoop目录下找不到winutils
于是,百度了一下,发现要下载hadoop-common-2.2.0-bin
去github下载,https://github.com/srccodes/hadoop-common-2.2.0-bin
- 解压,
- 配环境变量
(1)HADOOP_HOME
D:\software\apache\hadoop-common-2.2.0-bin-master
(2)path
修改path,
%HADOOP_HOME%\bin; 加到前面,注意分号分隔