资源下载:
https://download.csdn.net/download/weixin_35852328/10746477
异常:本地没有hadoop环境
/10/26 16:16:02 ERROR util.Shell: Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:404)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:419)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:412)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:168)
at org.apache.hadoop.security.Groups.<init>(Groups.java:132)
at org.apache.hadoop.security.Groups.<init>(Groups.java:100)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:435)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:337)
at org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:374)
解决方法1:配置本地hadoop环境变量
1、HADOOP_HOME : E:\\hadoop\\hadoop-common-2.2.0-bin-master
2、path : 添加 %HADOOP_HOME%\bin;
解决办法2:在代码中加入hadoop的目录
System.setProperty("hadoop.home.dir", "E:\\hadoop\\hadoop-common-2.2.0-bin-master");