CDH5 安装
集群部署
基本组件
CM 5.x
CDH 5.8.2
CM安装方式
- bin方式
http://archive.cloudera.com/cm5/installer/5.8.2/
- rpm包方式
http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.8.2/
- yum方式
http://archive.cloudera.com/cm5/repo-as-tarball/5.8.2/
软件准备
- CM(yum本地源方式安装)
cm5.8.2-centos6.tar.gz
cloudera-manager-installer.bin - CDH
CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel
CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel.sha1
manifest.json - postgresql-libs
postgresql-8.4.18-1.el6_4.x86_64.rpm
postgresql-libs-8.4.18-1.el6_4.x86_64.rpm
postgresql-server-8.4.18-1.el6_4.x86_64.rpm - repo-libs
createrepo-0.9.9-18.el6.noarch.rpm
deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm
python-deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm
机器环境准备
机器准备
7台,用于数据处理
CentOS6.7
4核 CPU
8G 内存
120GB SSD + 1T 硬盘
创建普通用户
adduser heimdall
passwd heimdall
创建普通用户的sudo权限
拥有执行权限
chmod u+w /etc/sudoers
修改sudoers
vi /etc/sudoers
添加
heimdall ALL=(root)NOPASSWD:ALL
收回执行权限
chmod u-w /etc/sudoers
静态ip
/etc/sysconfig/network-script/ifcfg-eth0
DEVICE=eth0
TYPE=Ethernet
ONBOOT=yes
BOOTPROTO=static
IPADDR=172.16.0.201
NETMASK=255.255.255.0
GATEWAY=172.16.0.1
DNS1=192.168.2.19
DNS2=192.168.2.12
防火墙 off
$ sudo service iptables stop
$ sudo chkconfig iptables off //永久性关闭
selinux off
/etc/sysconfig/selinux
修改selinux=disable
HOST 配置
/etc/hosts
172.16.0.