大数据Hadoop+Hive+Hbase的部署

1.基础环境的准备
1.1 准确4台服务器，尽量不要安装中文环境。
1.2 服务器的静态的IP的设置
1.3 系统安装的centos6.5
1.4 所用的软件版本如下：
    jdk-7u79-linux-x64.tar.gz
    zookeeper-3.4.6.tar.gz
    hadoop-2.5.1-x64.tar.gz
    apache-hive-1.2.1-bin.tar.gz
    hbase-0.98.15-hadoop2-bin.tar.gz 

2.基础环境的部署

2.1 主机名映射

vi /etc/hosts
192.168.100.11 node1
192.168.100.12 node2
192.168.100.13 node3
192.168.100.14 node4

2.2 关闭防火墙

 iptables –X
 iptables –F
 iptables –Z
 service iptables save
 vi /etc/selinux/config

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
#     enforcing - SELinux security policy is enforced.
#     permissive - SELinux prints warnings instead of enforcing.
#     disabled - No SELinux policy is loaded.
SELINUX=permissive

reboot

2.3  yum的配置和安装ftp

2.3.1 node1节点的配置

cd /etc/yum.repos.d/
rm -rf *
vi local.repo

[centos]
name=centos
baseurl=file:///opt/centos
gpgcheck=0
enabled=1

mkdir /opt/centos
mount /dev/sr0 /opt/centos/
yum clean all
yum list
yum install vsftpd –y
vi /etc/vsftpd/vsftpd.conf
加多一行anon_root=/opt---引导ftp到/opt目录下
service vsftpd restart
chkconfig vsftpd on

2.3.2其它节点的配置

cd /etc/yum.repos.d/
rm -rf *
vi local.repo

[centos]
name=centos
baseurl=ftp://192.168.100.11/centos
gpgcheck=0
enabled=1

yum clean all
yum list

2.4 安装openssh-clients 

yum install openssh-clients -y

2.5 安装ntp(全部所有节点)

yum install ntp –y 

node1：vi /etc/ntp.conf
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
server 0.centos.pool.ntp.org iburst
server 1.centos.pool.ntp.org iburst
server 2.centos.pool.ntp.org iburst
server 3.centos.pool.ntp.org iburst
server 127.127.1.0
fudge 127.127.1.0 stratum 10

service ntpd restart
chkconfig ntpd on

其他节点: ntpdate node1

Hadoop整个集群的角色分布
       NN    DN    JN   ZK  ZKFC   RS
node1   1                1   1
node2   1    1      1    1