java.io.IOException:Could not locate executable null\bin\winutils.exe in the Hadoop binaries

最新推荐文章于 2024-07-04 09:37:52 发布

崔世勋

最新推荐文章于 2024-07-04 09:37:52 发布

阅读量502

点赞数

分类专栏：大数据与云计算 java

java 同时被 2 个专栏收录

350 篇文章 0 订阅

订阅专栏

大数据与云计算

38 篇文章 0 订阅

订阅专栏

查看hadoop源码发现有一段：

public static final String getQualifiedBinPath(String executable) 
  throws IOException {
    // construct hadoop bin path to the specified executable
    String fullExeName = HADOOP_HOME_DIR + File.separator + "bin"
      + File.separator + executable;
 
    File exeFile = new File(fullExeName);
    if (!exeFile.exists()) {
      throw new IOException("Could not locate executable " + fullExeName
        + " in the Hadoop binaries.");
    }
 
    return exeFile.getCanonicalPath();
  }
 
private static String HADOOP_HOME_DIR = checkHadoopHome();
private static String checkHadoopHome() {
 
    // first check the Dflag hadoop.home.dir with JVM scope
    String home = System.getProperty("hadoop.home.dir");
 
    // fall back to the system/user-global env variable
    if (home == null) {
      home = System.getenv("HADOOP_HOME");
    }
     ...
}

很明显应该是HADOOP_HOME的问题。如果HADOOP_HOME为空，必然fullExeName为null\bin\winutils\exe。解决方法很简单，配置环境变量，不想重启电脑可以在程序里加上：

System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0");

然后，去github下载一个winutils.exe

<a data-cke-saved-href="https://github.com/srccodes/hadoop-common-2.2.0-bin" href="https://github.com/srccodes/hadoop-common-2.2.0-bin">https://github.com/srccodes/hadoop-common-2.2.0-bin</a>

最后欢迎大家访问我的个人网站：1024s