java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries 快速解决

报错信息:

java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
	at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:382)
	at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:397)
	at org.apache.hadoop.util.Shell.<clinit>(Shell.java:390)
	at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
	at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:806)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:776)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:649)
	at org.apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2412)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2412)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:308)
	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2574)
	at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:934)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:928)
	at cn.itcast.sql.Demo01$.main(Demo01.scala:14)
	at cn.itcast.sql.Demo01.main(Demo01.scala)

**报错原因:**spark运行缺少本地Hadoop环境,您缺少winutils.exe，一个hadoop二进制文件。

首先下载winutils.exe文件,链接：https://pan.baidu.com/s/1fPVtQxzHv5oRW14Far3y3Q
提取码：CCNB

解决办法一:
快速解决:

//在程序中添加如下代码,快速解决当前类问题,彻底解决解决办法二操作
System.setProperty("hadoop.home.dir","我提供的文件夹的目录")
//例如
System.setProperty("hadoop.home.dir","D:\\OPT\\IDEA\\IDEA-plugins\\Hadoop")

然后重新运行程序,无效重启IDEA再尝试下,或尝试下解决办法二

解决办法二:
添加环境变量:
打开环境变量:
1.在用户变量创建HADOOP_HOME,变量值选择Hadoop文件夹存放位置
2.在系统变量中找到Path,没有则创建,变量值中添加引号中内容,"%HADOOP_HOME%\bin ;" 如果要放到开头,注意最后的";"号,不要丢了
3.点击确定保存,重启计算机,不想现在重启计算机,可以使用解决办法一,等下次重启则此配置生效

本文原创,如需转发引用,请注明出处

有用的话点个赞呦

链接失效可评论/私信