南大通用GBase 8s中的IWA安装及使用详解 - 01

原文链接:https://www.gbase.cn/community/post/4242
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。

南大通用GBase 8s数据库通过其内存数据仓库加速器(IWA)技术,为企业提供了一个高性能的解决方案。本系列文章将讲解IWA的基本概念,并详细介绍如何在南大通用GBase 8s中安装和配置IWA。

IWA概述

什么是IWA?

IWA(In-Memory Warehouse Accelerator,内存数据仓库加速器)是一种基于内存的数据仓库技术,它通过将数据加载到内存中来提高查询性能。与传统的磁盘存储相比,内存存储可以显著减少数据访问延迟,实现更快的数据处理速度。

本文将介绍GBase 8s 中IWA的安装部署,并给出使用IWA的详细示例。

IWA优势

快速响应:利用内存的高速访问能力,IWA能够实现对复杂查询的快速响应。

并行处理:IWA支持多线程并行处理,进一步提高数据处理效率。

易于集成:IWA与GBase 8s数据库紧密集成,无需复杂的配置即可使用。

使用版本

本文使用的数据库版本和IWA的版本如下:

GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar

IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar

安装部署

1、安装数据库

首先解压安装包:

tar xvf GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar

进行安装,安装过程如下,蓝色部分是需要交互的。

[root@8s-225 setup]# ./ids_install

Preparing to install...

Extracting the JRE from the installer archive...

Unpacking the JRE...

Extracting the installation resources from the installer archive...

Configuring the installer for this system's environment...

Launching installer...

===============================================================================

GBase Software Bundle                            (created with InstallAnywhere)

-------------------------------------------------------------------------------

Preparing CONSOLE Mode Installation...

===============================================================================

Getting Started

---------------

This application  will guide you through the installation of GBase Software

Bundle.

Copyright General Data Corporation 2014, 2024. All rights reserved.

1. Release Notes

The Release Notes can be found in

/opt/hyq/3.5.0_2O2_for_iwa/setup/doc/ids_unix_relnotes_12.10.html.

2. Launch Information Center

Access the GBase Information Center at http://www.gbase.cn.

To Begin Installation, respond to each prompt to proceed to the next step in

the installation.

If you want to change something on a previous step, type 'back'.

You may cancel this installation at any time by typing 'quit'.

PRESS <ENTER> TO CONTINUE:

===============================================================================

License Agreement

-----------------

Installation and Use of GBase Software Bundle Requires Acceptance of the

Following License Agreement:

Thank you for choosing GBase product!

Please read carefully the following licencing agreement before installing any

product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT

READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS

(COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE.

BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS

AGREEMENT.  IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR

ACCEPTANCE OF THESE  TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY

RETURN THE UNUSED  SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND.

1. LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable

license for  the internal use only of the accompanying software and

documentation and any error corrections  provided by GeneralData(collectively

"Software"), by the number of users and the class of  computer hardware for

which the corresponding fee has been paid.

2. RESTRICTIONS. Software is confidential and copyrighted. Title to Software

PRESS <ENTER> TO CONTINUE:

and all   associated intellectual property rights is retained by GeneralData

and/or its licensors. Except as  specifically authorized in any Supplemental

License Terms, you may not make copies of Software,  other than a single copy

of Software for archival purposes. Unless enforcement is prohibited by

applicable law, you may not modify, decompile, or reverse engineer Software.

You acknowledge  that Software is not designed, licensed or intended for use in

the design, construction, operation  or maintenance of any nuclear facility.

GeneralData disclaims any express or implied warranty  of fitness for such

uses. No right, title or interest in or to any trademark, service mark, logo or

trade name of GeneralData or its licensors is granted under this Agreement.

3. DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of

implied   conditions, representations and warranties, including any implied

warranty of merchantability,  fitness for aparticular purpose or

non-infringement are disclaimed, except to theextent that  these disclaimers

are held to be legally invalid.

4. LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event

will GeneralData  or its licensors be liable for any lost revenue, profit or

data, or for special, indirect,  consequential, incidental orpunitive damages,

however caused regardless of the theory of liability,  arising out of or

related to the use of or inability to use software, even if GeneralData has

PRESS <ENTER> TO CONTINUE:

been   advised of the possibility of such damages. In no event will

GeneralData's libility to you, whether  incontract, tort(including negligence),

or otherwise, exceed the amount paid by you for Software  under this Agreement.

The foregoing limitations will apply even if the above stated warranty  fails

of itsessential purpose.

5. TERMINATION. This Agreement is effective until terminated. You may terminate

this   Agreement at any time by destroying all copies of Software. This

Agreement will terminate  immediately without noticefrom GeneralData if you

fail to comply with any provision of this  Agreement. Upon Termination, you

must destroy all copies of Software.

6. EXPORT REGULATIONS. All Software and technical data delivered under this

Agreement are  subject to US export control laws and may be subject to export

or import regulations in other  countries. You agree to comply strictly with

all such laws and regulations and acknowledge that  you have the responsibility

to obtain such licenses to export, re-export, or import as may be   required

after delivery to you.

7. CHINESE * RESTRICTED. If Software is being acquired by or on behalf

PRESS <ENTER> TO CONTINUE:

of the   Chinese *, then the * rights in Software and

accompanying documentation  will be only as set forth in this Agreement.

8. GOVERNING LAW. Any action related to this Agreement will be governed by

Chinese law:  "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF

THE PEOPLE'S  REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF

CHINA", "COMPUTER  SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF

CHINA". No choice of  law rules of any jurisdiction will apply."

9. SEVERABILITY. If any provision of this Agreement is held to be

unenforceable, this  Agreement will remain in effect with the provision

omitted, unless omission would frustrate the  intent of the parties, in which

case this Agreement will immediately terminate.

10. INTEGRATION. This Agreement is the entire agreement between you and

GeneralData  relating to its subject matter. It supersedes all prior or

contemporaneous oral or written  communications, proposals, representations and

warranties and prevails over any conflicting or  additional terms of any quote,

order, acknowledgment, or other communication between the  parties relating to

its subject matter during the term of this Agreement. No modification of this

Agreement will be binding, unless in writing and signed by an authorize

depresentative of each  party. When the translation document has the different

PRESS <ENTER> TO CONTINUE:

meaning or has the conflicting views with  Chinese original text conflict,

should take the laws and regulations promulgation unit as well as  the

GeneralData issue Chinese original text as the standard.

All trademarks and registered trademarks mentioned herein are the  property of

their respective owners.

DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y

===============================================================================

Installation Location

---------------------

Choose location for software installation.

   Default Install Folder: /opt/GBASE/gbase

ENTER AN ABSOLUTE PATH, OR PRESS <ENTER> TO ACCEPT THE DEFAULT

      : /opt/hyq/3.5.0_2O2_for_iwa/ids

INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids

    IS THIS CORRECT? (Y/N): Y

===============================================================================

Installation or Distribution

----------------------------

Select the installation type.

Typical: Install the database server with all features and a database server

that

is configured with default values. Includes:

** Client Software Development Kit (CSDK)

** Java Database Connectivity (JDBC)

Minimum disk space required: 700-800MB

Custom: Install the database server with specific features and software that

you need.

Optionally install a configured database server instance.

Minimum disk space required: 75 MB (without a server instance)

  ->1- Typical installation

     2- Custom installation

     3- Extract the product files (-DLEGACY option)

     4- Create a RPM package for redistribution

ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT::

===============================================================================

Server Instance Creation

------------------------

Create a server instance?

   ->1- Yes - create an instance

     2- No - do not create an instance

ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT::

===============================================================================

Configuration - Number of Users

-------------------------------

Select the number of expected database users.

  ->1- 1 - 100

     2- 101 - 500

     3- 501 - 1000

     4- 1000+

ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT::

===============================================================================

Ready To Install

----------------

InstallAnywhere is now ready to install GBase Software Bundle onto your system

at the following location:

    /opt/hyq/3.5.0_2O2_for_iwa/ids

PRESS <ENTER> TO INSTALL:

===============================================================================

Installing...

-------------

 [==================|==================|==================|==================]

 [------------------|------------------|------------------|------------------]

===============================================================================

Server Initialization

---------------------

The server will now be initialized. Initialization might take quite a while,

depending on the performance of your computer.

PRESS <ENTER> TO CONTINUE:

===============================================================================

Using the new instance

----------------------

A database server instance was created. If you chose to initialize the

instance, it is ready to use.

You can open a command prompt to an initialized instance by running one of the

following commands at /opt/hyq/3.5.0_2O2_for_iwa/ids, where

ol_gbasedbt1210_20240807102321 is the path or filename of the instance.

Windows:

ol_gbasedbt1210_20240807102321.cmd

UNIX csh:

source ol_gbasedbt1210_20240807102321.csh

UNIX ksh or bourne:

./ol_gbasedbt1210_20240807102321.ksh

If initialization fails, check the online.log file for messages. The instance's

root chunk must be owned by the correct user and group, and it must have

readable and writable (rw) permission bits set only for owner and group.

PRESS <ENTER> TO CONTINUE:

===============================================================================

Installation Complete

---------------------

Congratulations! GBase Software Bundle installation is complete.

Product install status:

GBase: Successful

GBase Connect: Successful

GBase 8s V8.8

For more information about using GBase products, see the GBase Information

Center at http://www.gbase.cn.

PRESS <ENTER> TO EXIT THE INSTALLER:

设定环境变量

需要设定环境变量,才能使用相关命令。

cd /opt/hyq/3.5.0_2O2_for_iwa/ids
source ol_gbasedbt1210_20240807102321.ksh

2、安装iwa

首先解压安装包:

tar xvf IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar

进行安装,安装过程如下,蓝色部分是需要交互的。

[root@8s-225 setup]# ./iwa_install

Preparing to install...

Extracting the JRE from the installer archive...

Unpacking the JRE...

Extracting the installation resources from the installer archive...

Configuring the installer for this system's environment...

Launching installer...

===============================================================================

GBase Warehouse Accelerator                      (created with InstallAnywhere)

-------------------------------------------------------------------------------

Preparing CONSOLE Mode Installation...

===============================================================================

Introduction

------------

InstallAnywhere will guide you through the installation of GBase Warehouse

Accelerator.

Copyright GBASE  2011, 2014. All rights reserved.

Respond to each prompt to proceed to the next step in the installation.  If you

want to change something on a previous step, type 'back'.

You may cancel this installation at any time by typing 'quit'.

PRESS <ENTER> TO CONTINUE:

===============================================================================

License Agreement

-----------------

Installation and Use of GBase Warehouse Accelerator Requires Acceptance of the

Following License Agreement:

Thank you for choosing GBase product!

Please read carefully the following licencing agreement before installing any

product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT

READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS

(COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE.

BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS

AGREEMENT.  IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR

ACCEPTANCE OF THESE  TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY

RETURN THE UNUSED  SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND.

1. LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable

license for  the internal use only of the accompanying software and

documentation and any error corrections  provided by GeneralData(collectively

"Software"), by the number of users and the class of  computer hardware for

which the corresponding fee has been paid.

2. RESTRICTIONS. Software is confidential and copyrighted. Title to Software

PRESS <ENTER> TO CONTINUE:

and all   associated intellectual property rights is retained by GeneralData

and/or its licensors. Except as  specifically authorized in any Supplemental

License Terms, you may not make copies of Software,  other than a single copy

of Software for archival purposes. Unless enforcement is prohibited by

applicable law, you may not modify, decompile, or reverse engineer Software.

You acknowledge  that Software is not designed, licensed or intended for use in

the design, construction, operation  or maintenance of any nuclear facility.

GeneralData disclaims any express or implied warranty  of fitness for such

uses. No right, title or interest in or to any trademark, service mark, logo or

trade name of GeneralData or its licensors is granted under this Agreement.

3. DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of

implied   conditions, representations and warranties, including any implied

warranty of merchantability,  fitness for aparticular purpose or

non-infringement are disclaimed, except to theextent that  these disclaimers

are held to be legally invalid.

4. LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event

will GeneralData  or its licensors be liable for any lost revenue, profit or

data, or for special, indirect,  consequential, incidental orpunitive damages,

however caused regardless of the theory of liability,  arising out of or

related to the use of or inability to use software, even if GeneralData has

PRESS <ENTER> TO CONTINUE:

been   advised of the possibility of such damages. In no event will

GeneralData's libility to you, whether  incontract, tort(including negligence),

or otherwise, exceed the amount paid by you for Software  under this Agreement.

The foregoing limitations will apply even if the above stated warranty  fails

of itsessential purpose.

5. TERMINATION. This Agreement is effective until terminated. You may terminate

this   Agreement at any time by destroying all copies of Software. This

Agreement will terminate  immediately without noticefrom GeneralData if you

fail to comply with any provision of this  Agreement. Upon Termination, you

must destroy all copies of Software.

6. EXPORT REGULATIONS. All Software and technical data delivered under this

Agreement are  subject to US export control laws and may be subject to export

or import regulations in other  countries. You agree to comply strictly with

all such laws and regulations and acknowledge that  you have the responsibility

to obtain such licenses to export, re-export, or import as may be   required

after delivery to you.

7. CHINESE *RESTRICTED. If Software is being acquired by or on behalf

PRESS <ENTER> TO CONTINUE:

of the   Chinese *, then the *rights in Software and

accompanying documentation  will be only as set forth in this Agreement.

8. GOVERNING LAW. Any action related to this Agreement will be governed by

Chinese law:  "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF

THE PEOPLE'S  REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF

CHINA", "COMPUTER  SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF

CHINA". No choice of  law rules of any jurisdiction will apply."

9. SEVERABILITY. If any provision of this Agreement is held to be

unenforceable, this  Agreement will remain in effect with the provision

omitted, unless omission would frustrate the  intent of the parties, in which

case this Agreement will immediately terminate.

10. INTEGRATION. This Agreement is the entire agreement between you and

GeneralData  relating to its subject matter. It supersedes all prior or

contemporaneous oral or written  communications, proposals, representations and

warranties and prevails over any conflicting or  additional terms of any quote,

order, acknowledgment, or other communication between the  parties relating to

its subject matter during the term of this Agreement. No modification of this

Agreement will be binding, unless in writing and signed by an authorize

depresentative of each  party. When the translation document has the different

PRESS <ENTER> TO CONTINUE:

meaning or has the conflicting views with  Chinese original text conflict,

should take the laws and regulations promulgation unit as well as  the

GeneralData issue Chinese original text as the standard.

All trademarks and registered trademarks mentioned herein are the  property of

their respective owners.

DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y

===============================================================================

Installation Location

---------------------

Where would you like to install GBase Warehouse Accelerator?

   Default Install Folder: /opt/ibm/gbasedbt

ENTER AN ABSOLUTE PATH, OR PRESS <ENTER> TO ACCEPT THE DEFAULT

      : /opt/hyq/3.5.0_2O2_for_iwa/ids

INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids

   IS THIS CORRECT? (Y/N): Y

===============================================================================

Configuration choice

--------------------

Would you like to configure GBase Warehouse Accelerator?

    1- Yes

  ->2- No

ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT::

===============================================================================

Pre-Installation Summary

------------------------

Please Review the Following Before Continuing:

Product Name:

     GBase Warehouse Accelerator

Install Folder:

     /opt/hyq/3.5.0_2O2_for_iwa/ids

Product Features:

     GBase Warehouse Accelerator

IWA storage directory

     /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo

Starting port

     21020

Number of nodes

     2

Worker shared memory

     500

Coordinator shared memory

     250

Disk Space Information (for Installation Target):

     Required:  115,999,848 Bytes

     Available: 351,137,013,760 Bytes

PRESS <ENTER> TO CONTINUE:

===============================================================================

Installing...

-------------

 [==================|==================|==================|==================]

 [------------------|------------------|------------------|------------------]

===============================================================================

Configuration file information

------------------------------

The installer has not configured the accelerator. A copy of the default

configuration file for the accelerator is located at

/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf. You should review and

customize this file for your environment.

PRESS <ENTER> TO CONTINUE:

===============================================================================

Installation Complete

---------------------

Congratulations. GBase Warehouse Accelerator has been successfully installed

to:

    /opt/hyq/3.5.0_2O2_for_iwa/ids

PRESS <ENTER> TO EXIT THE INSTALLER:

3、配置ids

如果要使用iwa, 则ids的配置需要调整。

打开onconfig文件,

vi /opt/hyq/3.5.0_2O2_for_iwa/ids/etc/onconfig.ol_gbasedbt1210_20240807102321

加入如下内容:

VPCLASS dwavp,num=1,max=1,noage

然后重新启动ids。

onmode  -ky
oninit   -v

4、配置IWA

修改iwa的配置文件:

vi /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf

调整内容如下:

######################

# Set DWA Environent #

######################

# DWA storage directory

# Stores the catalog, marts, logs, traces etc.

DWADIR=/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo

# Starting port number

# Grows to START_PORT-1+NUM_NODES*4 .

START_PORT=21020

# Number of nodes (DWA_CM processes)

NUM_NODES=2

# Worker shared memory

# SHM (in Megabyte) for all worker nodes.

# Minimum value is 1 percent of physical memory.

WORKER_SHM=100

# Coordinator shared memory

# SHM (in Megabyte) for all coordinator nodes.

# Minimum value is 1 percent of physical memory.

COORDINATOR_SHM=100

# DRDA network interface

# For running the accelerator on a separate computer ask the system

# administrator for the network interface (e.g. eth0) that the GBasedbt

# database server should connect to, or run the ifconfig command to find the

# network interface.

DRDA_INTERFACE=lo

# Cluster network interface

# For running the accelerator distributed on different nodes of a cluster ask

# the system administrator for the network interface (e.g. eth0) that the

# accelerator should use, or run the ifconfig command to find the network

# interface.

# Activate this parameter only to setup and start the accelerator on a cluster.

# Prerequisits:

# Use a cluster filesystem like GPFS to share the accelerator software and the

# DWA storage directory DWADIR between the nodes of the accelerator.

# Configure ssh login without password between all cluster nodes for user root.

# Store a list of cluster nodes (hostnames), one node per line, in file

# $GBASEDBTDIR/dwa/etc/cluster.conf

#CLUSTER_INTERFACE=eth0

# CPU percentage for load specific threads

# Calculates parameter CORES_FOR_LOAD_THREADS_PERCENTAGE which limits the

# maximum number of threads that the load process is allowed to use for

# building histograms and compressing cellblocks:

# CORES_FOR_LOAD_THREADS_PERCENTAGE=CPU_PERCENTAGE_LOAD/NUM_NODES

# On cluster CORES_FOR_LOAD_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_LOAD.

CPU_PERCENTAGE_LOAD=100

# CPU percentage for scan specific threads

# Calculates parameter CORES_FOR_SCAN_THREADS_PERCENTAGE which limits the

# maximum number of threads per machine that the query engine is allowed to

# use for scanning over cell block data:

# CORES_FOR_SCAN_THREADS_PERCENTAGE=CPU_PERCENTAGE_SCAN/NUM_NODES

# On cluster CORES_FOR_SCAN_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_SCAN.

CPU_PERCENTAGE_SCAN=100

以上,通过本文的介绍,您应能了解IWA的基本概念和优势,并掌握了在GBase 8s中安装和配置IWA的基本步骤。IWA作为一种强大的内存数据仓库加速器,将为您的数据库应用带来性能提升。在下一篇中我们来谈谈IWA的具体使用。感谢您的阅读。

原文链接:https://www.gbase.cn/community/post/4242
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值