1.用创建表的方法导入数据,导入时出现错误
hive> create table t2 as select * from t1;
Query ID = hadoop_20150126105050_186f3554-74bb-4388-a324-bf2c8feadb7d
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
java.net.ConnectException: Call From hd1/192.168.1.247 to hd1:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.GeneratedConstructorAccessor105.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
解决方法:
是因为节点上没有启动ResourceManager进程
[hadoop@hd1]$ jps
22450 HQuorumPeer
29683 RunJar
13269 HMaster
29096 NameNode
30318 Jps
[hadoop@hd1]$
查看yarn-ste.xml文件是否配置错误
[hadoop@hd1]$ vim yarn-site.xml
yarn.nodemanager.aux-services
mapreduce_shuffle
yarn.resourcemanager.address
hd1:8032
yarn.resourcemanager.scheduler.address
hd1:8030
yarn.resourcemanager.resource-tracker.address
hd1:8031
yarn.resourcemanager.admin.address
hd1:8033
yarn.resourcemanager.webapp.address
hd1:8088
yarn.nodemanager.aux-services.mapreduce.shuffle.class
org.apache.hadoop.mapred.ShuffleHandler
[hadoop@hd1]$ stop-all.sh --停止所有服务
This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
15/01/26 13:20:29 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Stopping namenodes on [hd1]
hd1: stopping namenode
tong2: no datanode to stop
tong3: no datanode to stop
15/01/26 13:20:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
stopping yarn daemons
no resourcemanager to stop
tong3: stopping nodemanager
tong2: stopping nodemanager
no proxyserver to stop
[hadoop@hd1]$ start-all.sh --启动所有服务
This
hive> create table t2 as select * from t1;
Query ID = hadoop_20150126105050_186f3554-74bb-4388-a324-bf2c8feadb7d
Total jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
java.net.ConnectException: Call From hd1/192.168.1.247 to hd1:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.GeneratedConstructorAccessor105.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)
at org.apache.hadoop.ipc.Client.call(Client.java:1472)
解决方法:
是因为节点上没有启动ResourceManager进程
[hadoop@hd1]$ jps
22450 HQuorumPeer
29683 RunJar
13269 HMaster
29096 NameNode
30318 Jps
[hadoop@hd1]$
查看yarn-ste.xml文件是否配置错误
[hadoop@hd1]$ vim yarn-site.xml
yarn.nodemanager.aux-services
mapreduce_shuffle
yarn.resourcemanager.address
hd1:8032
yarn.resourcemanager.scheduler.address
hd1:8030
yarn.resourcemanager.resource-tracker.address
hd1:8031
yarn.resourcemanager.admin.address
hd1:8033
yarn.resourcemanager.webapp.address
hd1:8088
yarn.nodemanager.aux-services.mapreduce.shuffle.class
org.apache.hadoop.mapred.ShuffleHandler
[hadoop@hd1]$ stop-all.sh --停止所有服务
This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
15/01/26 13:20:29 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Stopping namenodes on [hd1]
hd1: stopping namenode
tong2: no datanode to stop
tong3: no datanode to stop
15/01/26 13:20:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
stopping yarn daemons
no resourcemanager to stop
tong3: stopping nodemanager
tong2: stopping nodemanager
no proxyserver to stop
[hadoop@hd1]$ start-all.sh --启动所有服务
This