如何在Centos6.5下，部署完全分布式集群

我们来看下，如何在Centos6.5下，部署完全分布式集群。
下面先来看下具体的系统环境

序号

名称

描述

1

系统环境Centos6.5

最好在linux上部署

2

Hadoop版本Hadoop2.2.0

Hadoop2.x中的第一个稳定版本

3

JAVA环境JDK1.7

64位(build 1.7.0_25-b15)

部署情况

序号

IP地址

节点名

1

192.168.46.28

hp1(master)

2

192.168.46.29

hp2(slave)

3

192.168.46.30

hp3(slave)

部署步骤

序号

操作

1

配置SSH无密码登陆

2

配置环境变量JAVA(必须),MAVEN,ANT

3

配置Hadoop环境变量

4

配置core-site.xml文件

5

配置hdfs-site.xml文件

6

配置mapred-site.xml文件

7

配置yarn-site.xml文件

8

配置slaves文件

9

分发到从机上

10

在每台机器上格式化namenode

11

启动集群sbin/start-all.sh

12

执行jps命令，查询master与slave的java进程

13

测试页面访问，集群状态信息,

14

可以测试一个MR作业，验证集群

1，首先我们的集群之间的ssh是信任的，方便hadoop进程之间的通信。

生成公钥：ssh-keygen  -t rsa -P ''
拷贝信任:ssh-copy-id -i .ssh/id_rsa.pub  root@hp2
2，配置各种环境变量包括java，maven，ant，hadoop等的变量，代码如下：

Java代码  

1. export PATH=.:$PATH  
2.   
3. export JAVA_HOME="/usr/local/jdk"  
4. export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib  
5. export PATH=$PATH:$JAVA_HOME/bin  
6.   
7. export HADOOP_HOME=/root/hadoop  
8. export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop  
9. export CLASSPATH=.:$CLASSPATH:$HADOOP_HOME/lib  
10. export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin  
11.   
12. export ANT_HOME=/usr/local/ant  
13. export CLASSPATH=$CLASSPATH:$ANT_HOME/lib  
14. export PATH=$PATH:$ANT_HOME/bin  
15.   
16. export MAVEN_HOME="/usr/local/maven"  
17. export CLASSPATH=$CLASSPATH:$MAVEN_HOME/lib  
18. export PATH=$PATH:$MAVEN_HOME/bin  

export PATH=.:$PATH

export JAVA_HOME="/usr/local/jdk"
export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib
export PATH=$PATH:$JAVA_HOME/bin

export HADOOP_HOME=/root/hadoop
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export CLASSPATH=.:$CLASSPATH:$HADOOP_HOME/lib
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

export ANT_HOME=/usr/local/ant
export CLASSPATH=$CLASSPATH:$ANT_HOME/lib
export PATH=$PATH:$ANT_HOME/bin

export MAVEN_HOME="/usr/local/maven"
export CLASSPATH=$CLASSPATH:$MAVEN_HOME/lib
export PATH=$PATH:$MAVEN_HOME/bin

3，配置core-site.xml文件

Xml代码  

1. <?xml version="1.0" encoding="UTF-8"?>  
2. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
3. <!--  
4.   Licensed under the Apache License, Version 2.0 (the "License");  
5.   you may not use this file except in compliance with the License.  
6.   You may obtain a copy of the License at  
7.   
8.     http://www.apache.org/licenses/LICENSE-2.0  
9.   
10.   Unless required by applicable law or agreed to in writing, software  
11.   distributed under the License is distributed on an "AS IS" BASIS,  
12.   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  
13.   See the License for the specific language governing permissions and  
14.   limitations under the License. See accompanying LICENSE file.  
15. -->  
16.   
17. <!-- Put site-specific property overrides in this file. -->  
18.   
19. <configuration>  
20.     <property>    
21.         <name>fs.default.name</name>    
22.         <value>hdfs://192.168.46.28:9000</value>    
23.     </property>    
24.   <property>  
25.     <name>hadoop.tmp.dir</name>  
26.     <value>/root/hadoop/tmp</value>  
27.   </property>  
28.   
29. </configuration>  

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
    <property>  
        <name>fs.default.name</name>  
        <value>hdfs://192.168.46.28:9000</value>  
    </property>  
  <property>
    <name>hadoop.tmp.dir</name>
    <value>/root/hadoop/tmp</value>
  </property>

</configuration>

4,配置hdfs-site.xml文件

Xml代码  

1. <?xml version="1.0" encoding="UTF-8"?>  
2. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
3. <!--  
4.   Licensed under the Apache License, Version 2.0 (the "License");  
5.   you may not use this file except in compliance with the License.  
6.   You may obtain a copy of the License at  
7.   
8.     http://www.apache.org/licenses/LICENSE-2.0  
9.   
10.   Unless required by applicable law or agreed to in writing, software  
11.   distributed under the License is distributed on an "AS IS" BASIS,  
12.   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  
13.   See the License for the specific language governing permissions and  
14.   limitations under the License. See accompanying LICENSE file.  
15. -->  
16.   
17. <!-- Put site-specific property overrides in this file. -->  
18.   
19. <configuration>  
20. <property>    
21.    <name>dfs.replication</name>    
22.    <value>1</value>    
23.  </property>    
24.   
25.  <property>    
26.    <name>dfs.namenode.name.dir</name>    
27.    <value>/root/hadoop/nddir</value>    
28.  </property>    
29.   
30.   
31.  <property>    
32.    <name>dfs.datanode.data.dir</name>    
33.    <value>/root/hadoop/dddir</value>    
34.  </property>    
35.   
36. <property>    
37.   <name>dfs.permissions</name>    
38.   <value>false</value>    
39. </property>  
40.   
41. </configuration>  

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>  
   <name>dfs.replication</name>  
   <value>1</value>  
 </property>  

 <property>  
   <name>dfs.namenode.name.dir</name>  
   <value>/root/hadoop/nddir</value>  
 </property>  


 <property>  
   <name>dfs.datanode.data.dir</name>  
   <value>/root/hadoop/dddir</value>  
 </property>  

<property>  
  <name>dfs.permissions</name>  
  <value>false</value>  
</property>

</configuration>

配置mapred-site.xml文件

Xml代码  

1. <?xml version="1.0"?>  
2. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>  
3. <!--  
4.   Licensed under the Apache License, Version 2.0 (the "License");  
5.   you may not use this file except in compliance with the License.  
6.   You may obtain a copy of the License at  
7.   
8.     http://www.apache.org/licenses/LICENSE-2.0  
9.   
10.   Unless required by applicable law or agreed to in writing, software  
11.   distributed under the License is distributed on an "AS IS" BASIS,  
12.   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  
13.   See the License for the specific language governing permissions and  
14.   limitations under the License. See accompanying LICENSE file.  
15. -->  
16.   
17. <!-- Put site-specific property overrides in this file. -->  
18.   
19. <configuration>  
20. <property>  
21. <name>mapred.job.tracker</name>  
22. <value>hp1:8021</value>  
23. <final>true</final>  
24. <description>The host and port that the MapReduce JobTracker runs at. </description>  
25. </property>  
26. <property>    
27.     <name>mapreduce.cluster.temp.dir</name>    
28.     <value></value>    
29.     <description>No description</description>    
30.     <final>true</final>    
31.   </property>    
32.     
33.   <property>    
34.     <name>mapreduce.cluster.local.dir</name>    
35.     <value></value>    
36.     <description>No description</description>    
37.     <final>true</final>    
38.   </property>    
39. </configuration>  

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>mapred.job.tracker</name>
<value>hp1:8021</value>
<final>true</final>
<description>The host and port that the MapReduce JobTracker runs at. </description>
</property>
<property>  
    <name>mapreduce.cluster.temp.dir</name>  
    <value></value>  
    <description>No description</description>  
    <final>true</final>  
  </property>  
  
  <property>  
    <name>mapreduce.cluster.local.dir</name>  
    <value></value>  
    <description>No description</description>  
    <final>true</final>  
  </property>  
</configuration>

配置yarn-site.xml文件

Xml代码  

1. <?xml version="1.0"?>  
2. <!--  
3.   Licensed under the Apache License, Version 2.0 (the "License");  
4.   you may not use this file except in compliance with the License.  
5.   You may obtain a copy of the License at  
6.   
7.     http://www.apache.org/licenses/LICENSE-2.0  
8.   
9.   Unless required by applicable law or agreed to in writing, software  
10.   distributed under the License is distributed on an "AS IS" BASIS,  
11.   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  
12.   See the License for the specific language governing permissions and  
13.   limitations under the License. See accompanying LICENSE file.  
14. -->  
15. <configuration>  
16.   
17. <property>  
18. <name>yarn.nodemanager.aux-services</name>  
19. <value>mapreduce_shuffle</value>  
20. </property>  
21.   
22. <property>  
23. <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>  
24. <value>org.apache.hadoop.mapred.ShuffleHandler</value>  
25. </property>  
26.   
27. <property>  
28. <name>Yarn.nodemanager.aux-services</name>  
29. <value>mapreduce.shuffle</value>  
30. </property>  
31.   
32. <property>  
33. <name>yarn.resourcemanager.address</name>  
34. <value>hp1:8032</value>  
35. </property>  
36.   
37. <property>  
38. <name>yarn.resourcemanager.scheduler.address</name>  
39. <value>hp1:8030</value>  
40. </property>  
41.   
42. <property>  
43. <name>yarn.resourcemanager.resource-tracker.address</name>  
44. <value>hp1:8031</value>  
45. </property>  
46.   
47. <property>  
48. <name>yarn.resourcemanager.admin.address</name>  
49. <value>hp1:8033</value>  
50. </property>  
51.   
52. <property>  
53. <name>yarn.resourcemanager.webapp.address</name>  
54. <value>hp1:8088</value>  
55. </property>  
56.   
57. </configuration>  

<?xml version="1.0"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->
<configuration>

<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>

<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

<property>
<name>Yarn.nodemanager.aux-services</name>
<value>mapreduce.shuffle</value>
</property>

<property>
<name>yarn.resourcemanager.address</name>
<value>hp1:8032</value>
</property>

<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>hp1:8030</value>
</property>

<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>hp1:8031</value>
</property>

<property>
<name>yarn.resourcemanager.admin.address</name>
<value>hp1:8033</value>
</property>

<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>hp1:8088</value>
</property>

</configuration>

配置slaves文件

Java代码  

1. 192.168.46.28  
2. 192.168.46.29  
3. 192.168.46.30  

192.168.46.28
192.168.46.29
192.168.46.30

配置好后，注意，在hdfs-site.xml文件里的目录，需要自己在hadoop根目录下创建，以及hadoop的HDFS的tmp目录。一切做好之后，我们就可以分发整套hadoop到从机上，然后格式化namenode，并启动集群，使用jps在主机，和从机上分别显示如下：
master的jps显示如下：

Java代码  

1. 4335 SecondaryNameNode  
2. 4464 ResourceManager  
3. 4553 NodeManager  
4. 4102 NameNode  
5. 4206 DataNode  
6. 6042 Jps  

4335 SecondaryNameNode
4464 ResourceManager
4553 NodeManager
4102 NameNode
4206 DataNode
6042 Jps

slave上的jps显示如下:

Java代码  

1. 1727 DataNode  
2. 1810 NodeManager  
3. 2316 Jps  

1727 DataNode
1810 NodeManager
2316 Jps

确实jps命令显示的java进程正确，我们就可以访问，web界面进行查看了，截图如下：







至此，我们已经成功的部署完成hadoop集群，安装时，注意散仙的步骤，按这样顺序来，一般不容易不错。