hadoop-1.1.2 在centos环境下的部署

环境：

虚拟机

CentOS6.4

Java:默认的  OpenJDK1.7.0.9

1:配置JAVA_HOME

http://blog.csdn.net/wind520/article/details/9308809

2:下载

hadoop1.1.2  http://download.csdn.net/detail/wind520/5693609 

3:解压

tar zxf hadoop-1.1.2-bin.tar.gz

4：配置

hadoop1/conf下需要配置的文件：

1).hadoop-env.sh

2).core-site.xml

3).hdfs-site.xml

4).mapred-site.xml

如何修改请参考 http://blog.csdn.net/wind520/article/details/9225429

5：启动Hadoop

第一步，在hadoop目录下创建目录logs，用于保存日志
第二步，Format a new distributed-filesystem: 格式化namenode，创建HDFS
执行命令： ./hadoop namenode -format

[jifeng@localhost bin]$ ./hadoop namenode -format
13/07/12 17:56:14 INFO namenode.NameNode: STARTUP_MSG: 
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = localhost/127.0.0.1
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 1.1.2
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.1 -r 1440782; compiled by 'hortonfo' on Thu Jan 31 02:03:24 UTC 2013
************************************************************/
13/07/12 17:56:15 INFO util.GSet: VM type       = 32-bit
13/07/12 17:56:15 INFO util.GSet: 2% max memory = 19.33375 MB
13/07/12 17:56:15 INFO util.GSet: capacity      = 2^22 = 4194304 entries
13/07/12 17:56:15 INFO util.GSet: recommended=4194304, actual=4194304
13/07/12 17:56:15 INFO namenode.FSNamesystem: fsOwner=jifeng
13/07/12 17:56:15 INFO namenode.FSNamesystem: supergroup=supergroup
13/07/12 17:56:15 INFO namenode.FSNamesystem: isPermissionEnabled=true
13/07/12 17:56:15 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
13/07/12 17:56:15 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
13/07/12 17:56:15 INFO namenode.NameNode: Caching file names occuring more than 10 times 
13/07/12 17:56:15 INFO common.Storage: Image file of size 112 saved in 0 seconds.
13/07/12 17:56:16 INFO namenode.FSEditLog: closing edit log: position=4, editlog=/tmp/hadoop-jifeng/dfs/name/current/edits
13/07/12 17:56:16 INFO namenode.FSEditLog: close success: truncate to 4, editlog=/tmp/hadoop-jifeng/dfs/name/current/edits
13/07/12 17:56:16 INFO common.Storage: Storage directory /tmp/hadoop-jifeng/dfs/name has been successfully formatted.
13/07/12 17:56:16 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1
************************************************************/
[jifeng@localhost bin]$ ./start-all.sh
starting namenode, logging to /home/jifeng/down/hadoop/libexec/../logs/hadoop-jifeng-namenode-localhost.localdomain.out
jifeng@localhost's password: 
localhost: starting datanode, logging to /home/jifeng/down/hadoop/libexec/../logs/hadoop-jifeng-datanode-localhost.out
jifeng@localhost's password: 
localhost: secondarynamenode running as process 3118. Stop it first.
jobtracker running as process 3190. Stop it first.
jifeng@localhost's password: 
localhost: tasktracker running as process 4973. Stop it first.
[jifeng@localhost bin]$ 

第三步，启动Hadoop，执行命令： ./start-all.sh

需要输入3次密码.

hadoop默认的NameNode 和 JobTracker

<ul><li><span class="codefrag">NameNode</span> - <a target=_blank href="http://localhost:50070/"><span style="color:#336699;">http://localhost:50070/</span></a></li><li><span class="codefrag">JobTracker</span> - <a target=_blank href="http://localhost:50030/"><span style="color:#336699;">http://localhost:50030/</span></a></li></ul>

其他命令：

上传本地文件到HDFS

[jifeng@localhost hadoop]$ bin/hadoop fs -copyFromLocal local/hadoop.tar.gz /user/zip/hadoop.tar.gz

查看运行：
[jifeng@localhost hadoop]$ jps
2822 DataNode
3198 TaskTracker
3510 Jps
3043 JobTracker
2704 NameNode
2960 SecondaryNameNode