cloudera CDH5 Hadoop集群全套安装部署流程

CDH install

[detail installing PDF]($ sudo ./cloudera-manager-installer.bin)

official

create virtual machine

eth0: hostonly

eth1: bridge

configure network and host

• set ethX name and write down hardware address

  /etc/udev/rules.d/70-persistent-net.rules

• /etc/sysconfig/network-scripts/ifcfg-eth0

  DEVICE=eth0
  HWADDR=08:00:27:0F:B6:C1
  TYPE=Ethernet
  UUID=be125edc-4dda-4478-964b-285409fdc735
  ONBOOT=yes
  NM_CONTROLLED=yes
  BOOTPROTO=static
  IPADDR=192.168.56.2

  /etc/sysconfig/network-scripts/ifcfg-eth1

  DEVICE=eth1
  HWADDR=08:00:27:9D:D9:E6
  TYPE=Ethernet
  UUID=be125edc-4dda-4478-964b-285409fdc735
  ONBOOT=yes
  NM_CONTROLLED=yes
  BOOTPROTO=dhcp

• set host name and gateway

$ vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=master
#GATEWAY=192.168.1.1

• hosts

$vi /etc/hosts 
192.168.56.2 master
192.168.56.3 slave1

install perl

yum install perl

create user

sudo useradd -m cloudera
passwd cloudera

add to sudoer

visudo

无密码sudo权限

cloudera ALL=(root)NOPASSWD:ALL

trun off firewalls

• disable the selinux at all nodes

vi /etc/selinux/config
SELINUX=disabled #carfore! not SELINUXTYPE!!!

• close iptables firewall

chkconfig iptables off
chkconfig ip6tables off
service iptables stop

Time

date #view the time
#set all node's time zone to shanghai
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
#update time
yum install ntp
ntpdate pool.ntp.org
#update time manually
d