创建本地Hadoop集群

一 Hadoop需要的环境支持

1、操作系统的支持

Linux

Windows

    ——Cygwin

    ——hadoop-for-windows

2、JDK的支持

下载地址：http://www.oracle.com/technetwork/java/javase/downloads/index.html

安装完成后，再配置环境变量，最后查询版本

[root@localhost opt]# java -version

java version "1.8.0_152"

Java(TM) SE Runtime Environment (build 1.8.0_152-b16)

Java HotSpot(TM) 64-Bit Server VM (build 25.152-b16, mixed mode)

二 初学者应该选用哪个版本的Hadoop

三 如何安装和配置Hadoop

1、下载安装

http://hadoop.apache.org/releases.html

http://archive.apache.org/dist/

http://archive.apache.org/dist/hadoop/common/hadoop-1.2.1/

2、设置环境

2.1 设置环境变量

[root@localhost opt]# cat /etc/profile

export JAVA_HOME=/opt/jdk1.8

export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

export HADOOP_HOME=/opt/hadoop-1.2.1

export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin

2.2 配置相关文件

[root@localhost conf]# cat hadoop-env.sh

export JAVA_HOME=/opt/jdk1.8

3 设置SSH免密码登录并测试

[root@localhost conf]# ssh-keygen

Generating public/private rsa key pair.

Enter file in which to save the key (/root/.ssh/id_rsa):

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in /root/.ssh/id_rsa.

Your public key has been saved in /root/.ssh/id_rsa.pub.

The key fingerprint is:

9f:63:e4:3d:a4:96:12:e7:60:12:bd:77:95:98:5b:32 root@localhost.localdomain

The key's randomart image is:

+--[ RSA 2048]----+

|                 |

|       .     o . |

|      . .   E +  |

|       . .   *   |

|      . S + +    |

|       o X B     |

|        . @ o    |

|         + . .   |

|                 |

+-----------------+

[root@localhost conf]# cp /root/.ssh/id_rsa.pub /root/.ssh/authorized_keys

[root@localhost conf]# ssh localhost

\S

Kernel \r on an \m

Last login: Fri Dec  8 20:30:45 2017 from 192.168.0.103

hello cakin24!