【GP6安装配置】 Greenplum6.2.1 安装手记(上)

本文档详细记录了Greenplum6.2.1在redhat6.8上的安装配置过程,包括软硬件说明、依赖安装、系统参数配置等步骤。内容涵盖关闭防火墙、配置host、调整系统参数等,适用于内网环境的离线安装。文章强调了离线下载依赖、检查和修改系统参数的重要性,并提供了相关配置的参考资料链接。
摘要由CSDN通过智能技术生成

作者:lianghc

文档说明
      20191212 号,pivotal 发布gp6.2.1,适逢公司gp集群扩建升级,需要确定版本,所以安装gp6的版本与gp5做比对测试。
本文档参考官方文档,按照官方标准步骤一步一步安装完成。文档中列举了gp6 与旧版本安装的差异点。

目录

作者:lianghc

1. 软硬件说明及必要依赖安装

1.1 软硬件说明

1.2 必要依赖安装

 1.2.1 批量安装依赖包(需联网)

1.2.2 内网机需要人工下载后再上传至服务器

1.2.3 linux中离线下载

2 配置系统参数

2.1 关闭防火墙

2.1.1 检查SElinux(Security-Enhanced Linux)

2.1.2 检查 iptables 状态

2.1.3  检查firewalld(centos6 一般没有)

2.2 配置host

2.2.1 配置每台机器host 

2.2.2 配置/etc/hosts

2.3 配置sysctl.conf 

2.4 系统资源限制

2.5 XFS挂载选项

2.6 磁盘I/O 设置

2.7 修改rc.local 权限

2.8 磁盘I/O调度算法

2.9 Transparent Huge Pages (THP) 

2.10 IPC Object Removal

2.11 SSH连接阈值

2.12 同步集群时钟(NTP)

2.13 检查字符集

2.14 创建gpadmin用户


本文分为两部分

参数配置:【GP6安装配置】 Greenplum6.2.1 安装手记(上) 

执行安装:【GP6安装配置】 Greenplum6.2.1 安装手记(下)

时间

20191217

安装版本

greenplum 6.2.1

下载地址

https://network.pivotal.io/products/pivotal-gpdb/#/releases/526878

官方安装文档

https://gpdb.docs.pivotal.io/6-2/install_guide/platform-requirements.html

中文社区安装文档

https://greenplum.cn/2019/11/30/how-to-set-up-greenplum-6-1-cluster/

 

1. 软硬件说明及必要依赖安装


1.1 软硬件说明

1. 系统版本:redhat6.8 
2. 硬件:3台虚拟机,2核,16G内存,50G硬盘
3. 实验节点规划一个master, 4个segment,4个mirror,无standby

主机ip

host

节点规划

172.28.25.201

mdw

master

172.28.25.202

sdw1

seg1,seg2,mirror3,mirror4

172.28.25.203

sdw2

seg3,seg4,mirror1,mirror2

 

1.2 必要依赖安装

## 与旧版本差异点
gp4.x 无安装依赖检查步骤
gp5.x 使用rpm安装需要检查安装依赖
gp6.2 使用rpm需要检查安装依赖,使用yum install安装 会自动安装依赖,前提条件是需要联网

      GP6.X RPM版本安装前需要检查软件依赖,安装过程需要联网,若为内网机,需要先下载好相应的包。

 1.2.1 批量安装依赖包(需联网)

greenplum 5 是用rpm命令的,而greenplum 6 则用 yum install 直接安装依赖。

sudo yum install -y apr apr-util bash bzip2 curl krb5 libcurl libevent libxml2 libyaml zlib 
openldap openssh openssl openssl-libs perl readline rsync R sed tar zip krb5-devel


1.2.2 内网机需要人工下载后再上传至服务器

注意:操作系统版本位数 ,例如本次虚拟机是: el6.x86_64

[root@mdw ~]# uname -a
Linux mdw 2.6.32-642.el6.x86_64 #1 SMP Wed Apr 13 00:51:26 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux

下载地址: http://rpmfind.net/linux/rpm2html/search.php

1.2.3 linux中离线下载

        条件:
             1. 与安装gp 集群相同版本的操作系统
             2. 可联外网

yumdownloader --destdir ./ --resolve libyaml


2 配置系统参数

## 与旧版本差异点
gp6 无gpcheck 检查工具,但再gpinitsystem 环节会检查系统参数。
若不按照官方推荐参数修改,不影响集群安装,会影响集群性能

系统参数需要使用root用户修改,修改完需要重启系统,也可以修改完成后一并重启系统。
建议先修改master主机的参数,待安装好master的gp后,打通ssh,使用gpscp ,gpssh 批量修改其他节点的系统参数
参考文档:https://gpdb.docs.pivotal.io/6-2/install_guide/prep_os.html


2.1 关闭防火墙

2.1.1 检查SElinux(Security-Enhanced Linux)

使用root用户查看

[root@mdw ~]# sestatus
SELinux status:                 disabled

如果 SELinux status != disabled  ,修改 /etc/selinux/config 设置 ,随后重启系统(可以调节完参数后一并重启)
SELINUX=disabled

2.1.2 检查 iptables 状态

[root@mdw ~]# /sbin/chkconfig --list iptables
iptables        0:off   1:off   2:off   3:off   4:off   5:off   6:off

 如果状态没关闭,则修改,随后重启系统(可以调节完参数后一并重启)

/sbin/chkconfig ipt
  • 3
    点赞
  • 24
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 3
    评论
greenplum-db-6.2.1-rhel7-x86_64.rpm Pivotal Greenplum 6.2 Release Notes This document contains pertinent release information about Pivotal Greenplum Database 6.2 releases. For previous versions of the release notes for Greenplum Database, go to Pivotal Greenplum Database Documentation. For information about Greenplum Database end of life, see Pivotal Greenplum Database end of life policy. Pivotal Greenplum 6 software is available for download from the Pivotal Greenplum page on Pivotal Network. Pivotal Greenplum 6 is based on the open source Greenplum Database project code. Important: Pivotal Support does not provide support for open source versions of Greenplum Database. Only Pivotal Greenplum Database is supported by Pivotal Support. Release 6.2.1 Release Date: 2019-12-12 Pivotal Greenplum 6.2.1 is a minor release that includes new features and resolves several issues. New Features Greenplum Database 6.2.1 includes these new features: Greenplum Database supports materialized views. Materialized views are similar to views. A materialized view enables you to save a frequently used or complex query, then access the query results in a SELECT statement as if they were a table. Materialized views persist the query results in a table-like form. Materialized view data cannot be directly updated. To refresh the materialized view data, use the REFRESH MATERIALIZED VIEW command. See Creating and Managing Materialized Views. Note: Known Issues and Limitations describes a limitation of materialized view support in Greenplum 6.2.1. The gpinitsystem utility supports the --ignore-warnings option. The option controls the value returned by gpinitsystem when warnings or an error occurs. If you specify this option, gpinitsystem returns 0 if warnings occurred during system initialization, and returns a non-zero value if a fatal error occurs. If this option is not specified, gpinitsystem returns 1 if initialization completes with warnings, and returns value of 2 or greater if a fatal error occurs. PXF version 5.10.0 is included, which introduces several new and changed features and bug fixes. See PXF Version 5.10.0 below. PXF Version 5.10.0 PXF 5.10.0 includes the following new and changed features: PXF has improved its performance when reading a large number of files from HDFS or an object store. PXF bundles newer tomcat and jackson libraries. The PXF JDBC Connector now supports pushdown of OR and NOT logical filter operators when specified in a JDBC named query or in an external table query filter condition. PXF supports writing Avro-format data to Hadoop and object stores. Refer to Reading and Writing HDFS Avro Data for more information about this feature. PXF is now certified with Hadoop 2.x and 3.1.x and Hive Server 2.x and 3.1, and bundles new and upgraded Hadoop libraries to support these versions. PXF supports Kerberos authentication to Hive Server 2.x and 3.1.x. PXF supports per-server user impersonation configuration. PXF supports concurrent access to multiple Kerberized Hadoop clusters. In previous releases of Greenplum Database, PXF supported accessing a single Hadoop cluster secured with Kerberos, and this Hadoop cluster must have been configured as the default PXF server. PXF introduces a new template file, pxf-site.xml, to specify the Kerberos and impersonation property settings for a Hadoop or JDBC server configuration. Refer to About Kerberos and User Impersonation Configuration (pxf-site.xml) for more information about this file. PXF now supports connecting to Hadoop with a configurable Hadoop user identity. PXF previously supported only proxy access to Hadoop via the gpadmin Greenplum user. PXF version 5.10.0 deprecates the following configuration properties. Note: These property settings continue to work. The PXF_USER_IMPERSONATION, PXF_PRINCIPAL, and PXF_KEYTAB settings in the pxf-env.sh file. You can use the pxf-site.xml file to configure Kerberos and impersonation settings for your new Hadoop server configurations. The pxf.impersonation.jdbc property setting in the jdbc-site.xml file. You can use the pxf.service.user.impersonation property to configure user impersonation for a new JDBC server configuration. Note: If you have previously configured a PXF JDBC server to access Kerberos-secured Hive, you must upgrade the server definition. See Upgrading PXF in Greenplum 6.x for more information. Changed Features Greenplum Database 6.2.1 includes these changed features: Greenplum Stream Server version 1.3.1 is included in the Greenplum distribution. Resolved Issues Pivotal Greenplum 6.2.1 is a minor release that resolves these issues: 29454 - gpstart During Greenplum Database start up, the gpstart utility did not report when a segment instance failed to start. The utility always displayed 0 skipped segment starts. This issue has been resolved. gpstart output was also enhanced to provide additional warnings and summary information about the number of skipped segments. For example: [WARNING]:-********

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 3
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

百事悠弦

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值