windows下运行hadoop的mr任务,控制台报一下错误:
缺少winutils.exe
ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:379)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:394)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:387)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
...........
缺少hadoop.dll
WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
本人使用hadoop3.1.3版本
使用的是3.0的winutils.exe、hadoop.dll,就没有报错了且成功运行。
下载地址:
https://github.com/4ttty/winutils/tree/master/hadoop-3.0.0/bin
百度云盘下载地址:
链接:https://pan.baidu.com/s/1t2yhgv2WZBT5zmd3OzHoDg
提取码:tsun
放置hadoop\bin目录下
其次环境变量path需要配置
%HADOOP_HOME%\bin;%HADOOP_HOME%\sbin