转自:https://blog.csdn.net/jssg_tzw/article/details/72730186
Kudu1.4在CentOS7 的安装与配置(rpm)
前言
Apache Kudu是一个比较新的大数据组建,在国内大规模应用的公司不多,Kudu的安装文档也只能找到官网上的一份,自己按照官网的步骤进行安装的过程中也遇到了一些问题,现记录下完整的安装过程。
为了简化操作:
* kudu master: *
hostname: apollo.spk.com
ip: 192.168.56.101
* kudu tablet: *
hostname: uranus.spk.com
ip: 192.168.56.102
1.下载:http://archive.cloudera.com/kudu/redhat/7/x86_64/kudu/5/RPMS/x86_64/
2.Kudu安装
# 安装依赖包
[root@uranus kudu]# yum -y install cyrus-sasl-plain lsb ntp
# 查看安装包
[root@uranus kudu]# ls
kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-debuginfo-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
# 安装kudu
[root@uranus kudu]# rpm -ivh kudu-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-master-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-tserver-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client0-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm kudu-client-devel-1.3.0+cdh5.11.0+0-1.cdh5.11.0.p0.13.el7.x86_64.rpm
3.Kudu配置
3.1.查看/etc/kudu/conf/下的配置文件列表
[root@uranus kudu]# ls -la /etc/kudu/conf/
total 8
drwxr-xr-x 2 root root 53 May 24 09:25 .
drwxr-xr-x 3 root root 33 May 24 09:25 ..
-rw-r--r-- 1 root root 233 Apr 12 17:08 master.gflagfile
-rw-r--r-- 1 root root 236 Apr 12 17:08 tserver.gflagfile
3.2.查看主,、从机/etc/kudu/master.gflagfile内容
[root@apollo kudu]# more /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
[root@uranus kudu]# more /etc/kudu/conf/master.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-master.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/master
--fs_data_dirs=/var/lib/kudu/master
3.3.查看主、从机/etc/kudu/conf/tserver.gflagfile
#主机
[root@uranus kudu]# more /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 #设置kudu master address
#从机(需要添回最后一行master address)
[root@uranus kudu]# more /etc/kudu/conf/tserver.gflagfile
# Do not modify these two lines. If you wish to change these variables,
# modify them in /etc/default/kudu-tserver.
--fromenv=rpc_bind_addresses
--fromenv=log_dir
--fs_wal_dir=/var/lib/kudu/tserver
--fs_data_dirs=/var/lib/kudu/tserver
--tserver_master_addrs=apollo.spk.com:7051 ######设置kudu master address
3.4.查看/etc/default/有关kudu配置的文件列表
[root@uranus kudu]# ls -la /etc/default/kudu*
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-master
-rw-r--r-- 1 root root 80 Apr 12 17:08 /etc/default/kudu-tserver
3.4.1.修改/etc/default/kudu-master内容
#主机上设置kudu master
[root@apollo default]# vim kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###添加主机的地址
#从机上设置kudu master
[root@uranus kudu]# vim /etc/default/kudu-master
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7051
export FLAGS_rpc_bind_addresses=apollo.spk.com:7051 ###设置kudu master address
3.4.2.修改主从机/etc/default/kudu-tserver
#修改主机上的kudu tserver
[root@apollo default]# vim kudu-tserver
export FLAGS_log_dir=/var/log/kudu
export FLAGS_rpc_bind_addresses=0.0.0.0:7050
#修改改从机上的kudu tserver
[root@uranus kudu]# vim /etc/default/kudu-tserver
export FLAGS_log_dir=/var/log/kudu
#export FLAGS_rpc_bind_addresses=0.0.0.0:7050
export FLAGS_rpc_bind_addresses=uranus.spk.com:7050 #添加从机tserver
4.NTP同步
配置文件配置好后,进入/etc/init.d目录下,执行./ntpd restart来ntp同步,这个是安装kudu需要的。
#主机同步时间
[root@apollo init.d]# systemctl restart ntpd
#从机同步时间
[root@uranus init.d]# systemctl restart ntpd
#设置开机启动
[root@apollo init.d]# systemctl enable ntpd
[root@uranus init.d]# systemctl enable ntpd
5.设置kudu的用户及所属组
创建配置文件中的目录,并且修改用户和所属组,因为kudu已经默认创建好kudu用户,所以可以直接在目录下执行如下命令:
#主机
[root@apollo lib]# chown -R kudu:kudu /var/lib/kudu/
#从机
[root@uranus conf]# chown -R kudu:kudu /var/lib/kudu/
6.启动Kudu Master和Kudu Tablet
master 只需要在主节点(host1)上启动就可以,tablet server 需要在所有的节点(host1、host2、host3)上启动:
[root@apollo conf]# systemctl restart kudu-master #启动主机
[root@uranus ~]# systemctl restart kudu-tserver #启动从机