log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "main" java.lang.NullPointerException
at java.lang.ProcessBuilder.start(Unknown Source)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:482)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:646)
at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:472)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:460)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:426)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:887)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:784)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:365)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1968)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1937)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1913)
at com.chen.TestCopy.testCopyToLocal(TestCopy.java:24)
想要从Hadoop hdfs上下载文件到本地,结果报出空指针异常
解决的方法是:
在本地解压Hadoop,我的Hadoop用的版本是hadoop-2.5.0-cdh5.3.6
在环境变量中设置如下HADOOP_HOME和Path
再下载一个hadoop-common-2.2.0-bin.zip包,解压hadoop-common-2.2.0-bin.zip
里面有这些文件,然后把这些文件放到本地hadoop-2.5.0-cdh5.3.6文件下bin文件夹下,重启电脑即可。
出现这种问题的原因是在运行程序的时候找不到上面文件中的winutils.exe应用程序。