在学习Hadoop的时候遇到如下的问题:
Exception in thread "main" java.io.IOException: Error opening job jar: /apache_logs/cleaned.jar
at org.apache.hadoop.util.RunJar.main(RunJar.java:90)
Caused by: java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:127)
at java.util.jar.JarFile.<init>(JarFile.java:135)
at java.util.jar.JarFile.<init>(JarFile.java:72)
at org.apache.hadoop.util.RunJar.main(RunJar.java:88)
这里报错是hadoop fs -put /apache_logs/access_${yesterday}.log /hmbbs_logs 和
hadoop jar /apache_logs/cleaned.jar /hmbbs_logs/access_${yesterday}.log /hmbbs_cleaned/${yesterday}
使用相对路径就不行
于是改成了绝对路径就可以了;
hadoop fs -put /usr/local/apache_logs/access_${yesterday}.log /hmbbs_logs
hadoop jar /usr/local/apache_logs/cleaned.jar /hmbbs_logs/access_${yesterday}.log /hmbbs_cleaned/${yesterday}