hive开启很多信息和MR运行错误的原因。

hive> select count(url) from track_log;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
2016-03-21 22:23:20,892 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2360)) - file:/tmp/hadoop/hive_2016-03-21_22-23-14_888_6634347513296177843-1/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-03-21 22:23:20,988 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2360)) - file:/tmp/hadoop/hive_2016-03-21_22-23-14_888_6634347513296177843-1/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-03-21 22:23:21,267 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
2016-03-21 22:23:21,268 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
2016-03-21 22:23:21,268 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2016-03-21 22:23:21,269 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
2016-03-21 22:23:21,272 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
2016-03-21 22:23:21,273 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2016-03-21 22:23:21,275 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1011)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2016-03-21 22:23:21,926 WARN  [main] conf.HiveConf (HiveConf.java:initialize(1155)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
Execution log at: /tmp/hadoop/hadoop_20160321222323_ebcc54d6-c8ba-4b9b-9709-79002fb51018.log
Job running in-process (local Hadoop)
2016-03-21 22:23:27,242 null map = 0%,  reduce = 0%
2016-03-21 22:23:29,282 null map = 100%,  reduce = 100%
Ended Job = job_local1262919648_0001
Execution completed successfully
MapredLocal task succeeded
OK
126134
Time taken: 15.171 seconds, Fetched: 1 row(s)

 

出现这个原因是Hadoop 的 CORE-site.xml 等配置错误了。恢复配置文件就行了。

 

[hadoop@master hadoop]$ rm -rf conf

[hadoop@master hadoop]$ sudo rm -rf conf

[hadoop@master hadoop]$ ls

conf.cloudera.hdfs  conf.cloudera.mapreduce

[hadoop@master hadoop]$ sudo mkdir conf

[hadoop@master hadoop]$ sudo cp conf.cloudera.hdfs/* conf/

[hadoop@master hadoop]$ sudo cp conf.cloudera.mapreduce/* conf/

 

文件恢复 OK了!

 

 

 

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值