前期准备
禁用IPv6
# echo "alias net-pf-10 off" >> /etc/modprobe.d/dist.conf
# echo "alias ipv6 off" >> /etc/modprobe.d/dist.conf
关闭防火墙
$ sudo service iptables stop
$ sudo chkconfig iptables off
禁用Selinux
$ sudo vi /etc/sysconfig/selinux
修改:SELINUX=disabled
卸载自带JDK
$ sudo rpm -qa|grep java
$ sudo rpm -e --nodeps 'jdkname'
设置文件打开数量和用户最大进程数
文件打开数量
$ ulimit -a
用户最大进程数
$ ulimit -u
设置
$ sudo vi /etc/security/limits.conf
内容:
* soft nofile 65535
* hard nofile 65535
* soft nproc 32000
* hard nproc 32000
集群时间同步:以本地集群的一台服务器为准
·找一台机器作为【时间服务器】
·客户端同步:定任务Linux Crontab
开始安装:断网 + rpm 安装 + yum本地源
以 CDH5.3.6 为例
软件下载:http://archive.cloudera.com/cm5/
1.bin文件: http://archive.cloudera.com/cm5/installer/5.3.6/cloudera-manager-installer.bin
2.依赖rpm包 : http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/RPMS/x86_64/ 下所有的rpm包
yum本地源
- 开启apache服务器:
$sudo service httpd status
$sudo service httpd start
$sudo chkconfig httpd on
2.搭建本地源:
$sudo mkdir -p /var/www/html/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64,并将之前下载的rpm包放入该目录下
注释:apache服务器根目录对应本地服务器的/var/www/html/,搭建的目的是为了构建出一个本地可访问的:http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.3.6/RPMS/x86_64/
3.创建“repodata”
$ cd /var/www/html/cm5/redhat/6/x86_64/cm/5
$ createrepo ./
注释:安装 createrepo 工具:
1.下载rpm包: https://pkgs.org/download/createrepo
2.下载依赖包:https://pkgs.org/download/deltarpm和https://pkgs.org/download/python-deltarpm;
createrepo-0.9.9-26.el6.noarch.rpm
deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm
python-deltarpm-3.5-0.5.20090913git.el6.x86_64.rpm
3.安装 :$rpm -ivh ./*.rpm
- 安装 postgresql
1.$rpm -qa|grep postgres
$rpm -e xxx
2.前往:http://yum.postgresql.org/8.4/redhat/rhel-6-x86_64/repoview/ 上下载postgresql8.4的下面三个包
postgresql84-8.4.21-1PGDG.rhel6.x86_64.rpm
postgresql84-libs-8.4.21-1PGDG.rhel6.x86_64.rpm
postgresql84-server-8.4.21-1PGDG.rhel6.x86_64.rpm
3.安装postgresql-server
$rpm -ivh ./*
5.配置yum 源
$vi /etc/yum.repos.d/cloudera-manager.repo
输入内容:
[cloudera-manager]
name=Cloudera Manager
baseurl=http://test1/cm5/redhat/6/x86_64/cm/5/
gpgcheck=0
enabled=1
6.通过之前下载的bin文件进行安装
常见问题
- No package oracle-j2sdk1.7 available.
Error: Nothing to do
$yum clean all
$rm -rf /var/cache/yum/cloudera-*
到此为止,完成 cloudera server 的安装