windows和cygwin下hadoop安装配置

在Windows下利用cygwin仿unix环境安装配置Hadoop。

1、  所需软件

1.1、Cygwin

下载地址：http://www.cygwin.com/setup.exe

2、  安装

2.1、Cygwin安装说明见文章：http://www.zihou.me/2010/02/19/1506/

2.2、JDK的安装省略了

2.3、hadoop-0.20.1安装

将hadoop-0.20.1.tar.gz解压，解压后的目录如hadoop-0.20.1，假设是放在E盘：

E:\hadoop-0.20.1，修改conf/hadoop-env.sh文件，将export JAVA_HOME的值修改为你机上的jdk安装目录，比如/cygdrive/d/tools/jdk1.6.0_03，/cygdrive是Cygwin安装成功后系统的根目录

3、  安装和配置ssh

3.1、安装

在Cygwin的根目录下分别运行：

$ chmod +r /etc/group

$ chmod +r /etc/passwd

$ chmod +rwx /var

$ ssh-host-config

*** Info: Generating /etc/ssh_host_key

*** Info: Generating /etc/ssh_host_rsa_key

*** Info: Generating /etc/ssh_host_dsa_key

*** Info: Creating default /etc/ssh_config file

*** Info: Creating default /etc/sshd_config file

*** Info: Privilege separation is set to yes by default since OpenSSH 3.3.

*** Info: However, this requires a non-privileged account called 'sshd'.

*** Info: For more info on privilege separation read /usr/share/doc/openssh/README.privsep.

*** Query: Should privilege separation be used? (yes/no) yes

*** Info: Note that creating a new user requires that the current account have

*** Info: Administrator privileges.  Should this script attempt to create a

*** Query: new local account 'sshd'? (yes/no) yes

*** Info: Updating /etc/sshd_config file

*** Info: Added ssh to C:\WINDOWS\system32\driversc\services

*** Info: Creating default /etc/inetd.d/sshd-inetd file

*** Info: Updated /etc/inetd.d/sshd-inetd

*** Warning: The following functions require administrator privileges!

*** Query: Do you want to install sshd as a service?

*** Query: (Say "no" if it is already installed as a service) (yes/no) yes

*** Query: Enter the value of CYGWIN for the daemon: [] cygwin

（注：此处输入的cygwin可以是任意的）

*** Info: The sshd service has been installed under the LocalSystem

*** Info: account (also known as SYSTEM). To start the service now, call

*** Info: `net start sshd' or `cygrunsrv -S sshd'.  Otherwise, it

*** Info: will start automatically after the next reboot.

*** Info: Host configuration finished. Have fun!

在询问yes/no的地方，统一输入yes，sshd就安装好了。

3.2配置

3.2.1、启动sshd服务

net start sshd

CYGWIN sshd 服务正在启动

CYGWIN sshd 服务已经启动成功

3.2.3、建立ssh的通道

$ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa

$ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

执行遍$ ssh localhost看看，如果没有问题，就说明sshd已经配置好了。

 

Hadoop单机环境配置 <转>

 

Hadoop 三台主机 集群搭建 详解 <转>