ubuntu下单机配置hadoop（图解）

  1：安装SSH

          root@li-virtual-machine:~# sudo apt-get install openssh-server

2  生成私钥和公钥：

root@li-virtual-machine:~# ssh-keygen -t rsa -P ""
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa):
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
cb:46:5a:1d:ae:93:d2:dd:4b:2f:2d:63:2e:9f:bf:3c root@li-virtual-machine
The key's randomart image is:
+--[ RSA 2048]----+
|                 |
|                 |
|          .      |
|         o .     |
|        S o      |
|       * = .     |
|      o O . o.   |
|       o ...==E  |
|           ====o |
+-----------------+

root@li-virtual-machine:~# cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys
root@li-virtual-machine:~# ssh localhost

Welcome to Ubuntu 11.10 (GNU/Linux 3.0.0-12-generic i686)

 * Documentation:  https://help.ubuntu.com/

471 packages can be updated.
211 updates are security updates.

Last login: Sat Mar 30 13:53:25 2013 from localhost

2下载并安装jdk，hadoop 

  我直接在ubuntu里面下载的jdk  jdk-6u38-linux-i586.bin(目录为/home/li/linengwei/jdk  jdk-6u38-linux-i586.bin),解压到当前目录 

设置环境变量

  view plain cop
  su root 
   vim /etc/profile  

用vim编辑器打开/etc目录下的profile，在文件末尾增加如下几行 ：(或者自己用编辑器打开)

 


3设定三个xml文件
 
这里需要设定 3 个文件： core-site.xml,hdfs-site.xml,mapred-site.xml

   core-site.xml:

 

   hdfs-site.xml：

  

 

   mapred-site.xml:

   

 

   4：格式化hdfs

    通过以上步骤，我们已经设定好Hadoop单机测试到环境，接着就是启动Hadoop到相关服务，格式化namenode,secondarynamenode,tasktracker:

root@li-virtual-machine:/home/li/linengwei/hadoop-1.1.2# source /home/li/linengwei/hadoop-1.1.2/conf/hadoop-env.sh

root@li-virtual-machine:/home/li/linengwei/hadoop-1.1.2# hadoop namenode -format
Warning: $HADOOP_HOME is deprecated.

13/03/30 14:08:02 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = li-virtual-machine/127.0.1.1
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 1.1.2
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.1 -r 1440782; compiled by 'hortonfo' on Thu Jan 31 02:03:24 UTC 2013
************************************************************/
13/03/30 14:08:03 INFO util.GSet: VM type       = 32-bit
13/03/30 14:08:03 INFO util.GSet: 2% max memory = 19.33375 MB
13/03/30 14:08:03 INFO util.GSet: capacity      = 2^22 = 4194304 entries
13/03/30 14:08:03 INFO util.GSet: recommended=4194304, actual=4194304
13/03/30 14:08:07 INFO namenode.FSNamesystem: fsOwner=root
13/03/30 14:08:07 INFO namenode.FSNamesystem: supergroup=supergroup
13/03/30 14:08:07 INFO namenode.FSNamesystem: isPermissionEnabled=true
13/03/30 14:08:07 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100
13/03/30 14:08:07 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
13/03/30 14:08:07 INFO namenode.NameNode: Caching file names occuring more than 10 times
13/03/30 14:08:08 INFO common.Storage: Image file of size 110 saved in 0 seconds.
13/03/30 14:08:08 INFO namenode.FSEditLog: closing edit log: position=4, editlog=/tmp/hadoop/hadoop-root/dfs/name/current/edits
13/03/30 14:08:08 INFO namenode.FSEditLog: close success: truncate to 4, editlog=/tmp/hadoop/hadoop-root/dfs/name/current/edits
13/03/30 14:08:08 INFO common.Storage: Storage directory /tmp/hadoop/hadoop-root/dfs/name has been successfully formatted.
13/03/30 14:08:08 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at li-virtual-machine/127.0.1.1
************************************************************/

5启动Hadoop：

   接着执行start-all.sh来启动所有服务，包括namenode,datanode：

 

^[[?1;2croot@li-virtual-machine:/home/li/linengwei/hadoop-1.1.2/#  cd bin

^[[?1;2croot@li-virtual-machine:/home/li/linengwei/hadoop-1.1.2/bin# start-all.sh
Warning: $HADOOP_HOME is deprecated.

starting namenode, logging to /home/li/linengwei/hadoop-1.1.2/logs/hadoop-root-namenode-li-virtual-machine.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting datanode, logging to /home/li/linengwei/hadoop-1.1.2/logs/hadoop-root-datanode-li-virtual-machine.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting secondarynamenode, logging to /home/li/linengwei/hadoop-1.1.2/logs/hadoop-root-secondarynamenode-li-virtual-machine.out
starting jobtracker, logging to /home/li/linengwei/hadoop-1.1.2/logs/hadoop-root-jobtracker-li-virtual-machine.out
localhost: Warning: $HADOOP_HOME is deprecated.
localhost:
localhost: starting tasktracker, logging to /home/li/linengwei/hadoop-1.1.2/logs/hadoop-root-tasktracker-li-virtual-machine.out
root@li-virtual-machine:/home/li/linengwei/hadoop-1.1.2/bin# 

检查运行状态

   所有的设置已完成，Hadoop也启动了，现在可以通过下面的操作来查看服务是否正常：

   

    http://localhost:50030/    - Hadoop管理介面

   

    http://localhost:50060/    - Hadoop Task Tracker状态

 

    http://localhost:50070/     - Hadoop DFS状态

 

 

   Hadoop管理界面：