Greenplum5.4.0分布式集群（4节点）安装与配置

Greenplum5.4.0分布式集群（4节点）安装与配置

1、环境介绍

Vmware虚拟机,4台

操作系统：Centos 7.4
硬件资源配置：   
    CPU：1
    内存：1Gb
    磁盘空间：20Gb   
    操作系统：centos 7.4(64)

Greenpoum5.4.0分布式集群,4节点

集群规划，详细如下：  
    192.168.2.10  gpdb01     主节点
    192.168.2.11  gpdb02     主节点切换备份节点
    192.168.2.12  gpdb03     数据节点1
    192.168.2.13  gpdb04     数据节点2

 

2、相关软件与下载

系统版本：Liunx7.4（64） 下载地址：https://vault.centos.org/

Greenplum版本：greenplum-db-5.4.0-rhel7-x86_64 下载地址：https://d13k9s5899twdr.cloudfront.net/product_files/Pivotal-Greenplum/338484d1-2991-4595-830d-5fcf22570277?Expires=1608884390&Signature=V8hLv-mkZEZdmOWKw-2O3Dnc-X5-6YA1WyAWsaZtpWk3m%7EfeHu0Zt4Nia4awxun-dIeQxtrB93n0Fqfvfz2OASJroUhxyIyhguijX8LfoQowdDffCbH1CujkBUGACE-iBGgNA%7EphFO8QO-EVZk2aKQF9rDD60492yaxq7cqYWPus1sArLwrRKh3Yip4wDH8mMpGa0u8sg9GvnIByRfgYLZtgbunOTQSfsMhArHEdLyVBQMK%7EZ73cVzLo-u6sup4zV61nBXlg4Fv-3RvUvky%7EDnFWml2rLJu6Uke8OWrHqz7sE8nDOYb-aIBWqOF-xSuoRSYcJKpOlaExbzHSkk9pcg__&Key-Pair-Id=APKAIOIREZ2UWYGOZQDA&filename=338484d1-2991-4595-830d-5fcf22570277

Greenplum管理监控工具：greenplum-cc-web-3.3.1-LINUX-x86_64 下载地址：https://d13k9s5899twdr.cloudfront.net/product_files/Pivotal-Greenplum/df14202a-7506-4533-abf2-68854fdaa043?Expires=1608708252&Signature=Zf1%7EMjxOKmTSrc89f9XW5nOLU65LGiahF23r6uyNDjBZz-35v0i%7EZ2uewUfBywjRSivR3Fn4YFNaAM3v7JMtlQND6rk-EtEOe9HeLv5WY2EhTxKVJ1jThQ4cAj-9BN3-Wqnx0TCXXPWh4hsuM5b9SnFDefmMgWpPcsoPmUtVlu9ZLPrRV8gmjaUY3dRX3KaIrdj7-a7av7EMhGkyqJmHJdpt4JHjuJpbU4Y0EnNz-t2451KyE9v-rf7KCniJLxLJi2zqGB72H9qs9t-RNg%7EyPvZVQWPbCAobWzO3Qvd63W7uSKkbg-9UeuBAISbOMCSYIPsd7%7EBCBHEZE%7E2gSWJvnQ__&Key-Pair-Id=APKAIOIREZ2UWYGOZQDA&filename=df14202a-7506-4533-abf2-68854fdaa043

3、系统环境配置

3.1 安装虚拟机环境部署

安装虚拟机系统

自行百度，参考网上资料：https://www.cnblogs.com/yiyongling/p/11104307.html

初始化配置规划

    192.168.2.10  gpdb01   主节点
    192.168.2.11  gpdb02   数据节点1
    192.168.2.12  gpdb03   数据节点2
    192.168.2.13  gpdb04   主节点切换备份节点

3.2 各节点间免密配置

编译配置各节点hostname和hosts，参考配置规划

所有节点，执行以下命令，并添加相关内容：

vi /etc/hostname 
#根据配置规划，在对应节点添加hostname，如主节点添加：
gpdb01 
vi /etc/hosts
#添加以下内容：
192.168.2.10 gpdb01
192.168.2.11 gpdb02
192.168.2.12 gpdb03
192.168.2.13 gpdb04

在对应主机按顺序分别执行以下命令,注意执行步骤在各主机上顺序执行

步骤一，生成密钥和公钥

--gpdb_01
#执行步骤一:
    ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
    cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
    cp ~/.ssh/id_dsa.pub ~/.ssh/id_dsa.pub_10
--gpdb_02
#执行步骤一: 
ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
cp ~/.ssh/id_dsa.pub ~/.ssh/id_dsa.pub_11   
--gpdb_03
#执行步骤一:     
ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
cp ~/.ssh/id_dsa.pub ~/.ssh/id_dsa.pub_12
--gpdb_04
#执行步骤一:     
ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
cp ~/.ssh/id_dsa.pub ~/.ssh/id_dsa.pub_13
​

步骤二，分发各公钥到其它节点

--gpdb_01
#执行步骤二:
    scp ~/.ssh/id_dsa.pub_10 root@gpdb02:~/.ssh/
    scp ~/.ssh/id_dsa.pub_10 root@gpdb03:~/.ssh/
    scp ~/.ssh/id_dsa.pub_10 root@gpdb04:~/.ssh/
--gpdb_02
#执行步骤二:
scp ~/.ssh/id_dsa.pub_11 root@gpdb01:~/.ssh/
scp ~/.ssh/id_dsa.pub_11 root@gpdb03:~/.ssh/
scp ~/.ssh/id_dsa.pub_11 root@gpdb04:~/.ssh/
--gpdb_03
#执行步骤二:
scp ~/.ssh/id_dsa.pub_12 root@gpdb01:~/.ssh/
scp ~/.ssh/id_dsa.pub_12 root@gpdb02:~/.ssh/
scp ~/.ssh/id_dsa.pub_12 root@gpdb04:~/.ssh/
--gpdb_04
#执行步骤二:
scp ~/.ssh/id_dsa.pub_13 root@gpdb01:~/.ssh/
scp ~/.ssh/id_dsa.pub_13 root@gpdb02:~/.ssh/
scp ~/.ssh/id_dsa.pub_13 root@gpdb03:~/.ssh/
​

步骤三，将各节点的公钥合并，完成免密配置

--gpdb_01
#执行步骤三:
    cat ~/.ssh/id_dsa.pub_11 >> ~/.ssh/authorized_keys
    cat ~/.ssh/id_dsa.pub_12 >> ~/.ssh/authorized_keys
    cat ~/.ssh/id_dsa.pub_13 >> ~/.ssh/authorized_keys
--gpdb_02
#执行步骤三:
cat ~/.ssh/id_dsa.pub_10 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_12 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_13 >> ~/.ssh/authorized_keys
--gpdb_03
#执行步骤三:
cat ~/.ssh/id_dsa.pub_10 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_11 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_13 >> ~/.ssh/authorized_keys
--gpdb_04
#执行步骤三:
cat ~/.ssh/id_dsa.pub_10 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_11 >> ~/.ssh/authorized_keys
cat ~/.ssh/id_dsa.pub_12 >> ~/.ssh/authorized_keys

3.3 关闭防火墙

各节点执行下以下命令，确保关闭防火墙

systemctl stop firewalld.service
systemctl disable firewalld.service
iptables -L -n
systemctl status firewalld

3.4 修改内核相关参数

在各节点执行以下命令，并添加相关内容

vi /etc/sysctl.conf 
 #添加或修改以下参数
    kernel.shmmax = 500000000
​
    kernel.shmmni = 4096
​
    kernel.shmall = 4000000000
​
    kernel.sem = 2000 4096000 2000 2048
​
    kernel.sysrq = 1
​
    kernel.core_uses_pid = 1
​
    kernel.msgmnb = 65536
​
    kernel.msgmax = 65536
​
    kernel.msgmni = 2048
​
    net.ipv4.tcp_syncookies = 1
​
    net.ipv4.ip_forward = 0
​
    net.ipv4.conf.default.accept_source_route = 0
​
    net.ipv4.tcp_tw_recycle = 1
​
    net.ipv4.tcp_max_syn_backlog = 4096
​
    net.ipv4.conf.all.arp_filter = 1
​
    net.ipv4.ip_local_port_range = 1025 65535
​
    net.core.netdev_max_backlog = 10000
​
    net.core.rmem_max = 2097152
​
    net.core.wmem_max = 2097152
​
    vm.overcommit_memory = 2

使配置文件生效

sysctl -p

各节点执行命令，并添加修改相关值

vi /etc/security/limits.conf
#添加或修改以下参数
    * soft nofile 65536
​
    * hard nofile 65536
​
    * soft nproc 131072
​
    * hard nproc 131072 

4、Greenplum安装配置

4.1 上传安装文件至/opt/目录并解压

执行命令

unzip greenplum-db-5.4.0-rhel7-x86_64.zip
unzip greenplum-cc-web-3.3.1-LINUX-x86_64.zip
#说明，解压后文件分别为：
greenplum-db-5.4.0-rhel7-x86_64.bin
greenplum-cc-w