原文链接:https://www.gbase.cn/community/post/4242
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。
南大通用GBase 8s数据库通过其内存数据仓库加速器(IWA)技术,为企业提供了一个高性能的解决方案。本系列文章将讲解IWA的基本概念,并详细介绍如何在南大通用GBase 8s中安装和配置IWA。
IWA概述
什么是IWA?
IWA(In-Memory Warehouse Accelerator,内存数据仓库加速器)是一种基于内存的数据仓库技术,它通过将数据加载到内存中来提高查询性能。与传统的磁盘存储相比,内存存储可以显著减少数据访问延迟,实现更快的数据处理速度。
本文将介绍GBase 8s 中IWA的安装部署,并给出使用IWA的详细示例。
IWA优势
快速响应:利用内存的高速访问能力,IWA能够实现对复杂查询的快速响应。
并行处理:IWA支持多线程并行处理,进一步提高数据处理效率。
易于集成:IWA与GBase 8s数据库紧密集成,无需复杂的配置即可使用。
使用版本
本文使用的数据库版本和IWA的版本如下:
GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
安装部署
1、安装数据库
首先解压安装包:
tar xvf GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
进行安装,安装过程如下,蓝色部分是需要交互的。
[root@8s-225 setup]# ./ids_install Preparing to install... Extracting the JRE from the installer archive... Unpacking the JRE... Extracting the installation resources from the installer archive... Configuring the installer for this system's environment... Launching installer... =============================================================================== GBase Software Bundle (created with InstallAnywhere) ------------------------------------------------------------------------------- Preparing CONSOLE Mode Installation... =============================================================================== Getting Started --------------- This application will guide you through the installation of GBase Software Bundle. Copyright General Data Corporation 2014, 2024. All rights reserved. 1. Release Notes The Release Notes can be found in /opt/hyq/3.5.0_2O2_for_iwa/setup/doc/ids_unix_relnotes_12.10.html. 2. Launch Information Center Access the GBase Information Center at http://www.gbase.cn. To Begin Installation, respond to each prompt to proceed to the next step in the installation. If you want to change something on a previous step, type 'back'. You may cancel this installation at any time by typing 'quit'. PRESS <ENTER> TO CONTINUE: =============================================================================== License Agreement ----------------- Installation and Use of GBase Software Bundle Requires Acceptance of the Following License Agreement: Thank you for choosing GBase product! Please read carefully the following licencing agreement before installing any product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS (COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE. BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS AGREEMENT. IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR ACCEPTANCE OF THESE TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY RETURN THE UNUSED SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND. 1. LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable license for the internal use only of the accompanying software and documentation and any error corrections provided by GeneralData(collectively "Software"), by the number of users and the class of computer hardware for which the corresponding fee has been paid. 2. RESTRICTIONS. Software is confidential and copyrighted. Title to Software PRESS <ENTER> TO CONTINUE: and all associated intellectual property rights is retained by GeneralData and/or its licensors. Except as specifically authorized in any Supplemental License Terms, you may not make copies of Software, other than a single copy of Software for archival purposes. Unless enforcement is prohibited by applicable law, you may not modify, decompile, or reverse engineer Software. You acknowledge that Software is not designed, licensed or intended for use in the design, construction, operation or maintenance of any nuclear facility. GeneralData disclaims any express or implied warranty of fitness for such uses. No right, title or interest in or to any trademark, service mark, logo or trade name of GeneralData or its licensors is granted under this Agreement. 3. DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of implied conditions, representations and warranties, including any implied warranty of merchantability, fitness for aparticular purpose or non-infringement are disclaimed, except to theextent that these disclaimers are held to be legally invalid. 4. LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event will GeneralData or its licensors be liable for any lost revenue, profit or data, or for special, indirect, consequential, incidental orpunitive damages, however caused regardless of the theory of liability, arising out of or related to the use of or inability to use software, even if GeneralData has PRESS <ENTER> TO CONTINUE: been advised of the possibility of such damages. In no event will GeneralData's libility to you, whether incontract, tort(including negligence), or otherwise, exceed the amount paid by you for Software under this Agreement. The foregoing limitations will apply even if the above stated warranty fails of itsessential purpose. 5. TERMINATION. This Agreement is effective until terminated. You may terminate this Agreement at any time by destroying all copies of Software. This Agreement will terminate immediately without noticefrom GeneralData if you fail to comply with any provision of this Agreement. Upon Termination, you must destroy all copies of Software. 6. EXPORT REGULATIONS. All Software and technical data delivered under this Agreement are subject to US export control laws and may be subject to export or import regulations in other countries. You agree to comply strictly with all such laws and regulations and acknowledge that you have the responsibility to obtain such licenses to export, re-export, or import as may be required after delivery to you. 7. CHINESE * RESTRICTED. If Software is being acquired by or on behalf PRESS <ENTER> TO CONTINUE: of the Chinese *, then the * rights in Software and accompanying documentation will be only as set forth in this Agreement. 8. GOVERNING LAW. Any action related to this Agreement will be governed by Chinese law: "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "COMPUTER SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF CHINA". No choice of law rules of any jurisdiction will apply." 9. SEVERABILITY. If any provision of this Agreement is held to be unenforceable, this Agreement will remain in effect with the provision omitted, unless omission would frustrate the intent of the parties, in which case this Agreement will immediately terminate. 10. INTEGRATION. This Agreement is the entire agreement between you and GeneralData relating to its subject matter. It supersedes all prior or contemporaneous oral or written communications, proposals, representations and warranties and prevails over any conflicting or additional terms of any quote, order, acknowledgment, or other communication between the parties relating to its subject matter during the term of this Agreement. No modification of this Agreement will be binding, unless in writing and signed by an authorize depresentative of each party. When the translation document has the different PRESS <ENTER> TO CONTINUE: meaning or has the conflicting views with Chinese original text conflict, should take the laws and regulations promulgation unit as well as the GeneralData issue Chinese original text as the standard. All trademarks and registered trademarks mentioned herein are the property of their respective owners. DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y =============================================================================== Installation Location --------------------- Choose location for software installation. Default Install Folder: /opt/GBASE/gbase ENTER AN ABSOLUTE PATH, OR PRESS <ENTER> TO ACCEPT THE DEFAULT : /opt/hyq/3.5.0_2O2_for_iwa/ids INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids IS THIS CORRECT? (Y/N): Y =============================================================================== Installation or Distribution ---------------------------- Select the installation type. Typical: Install the database server with all features and a database server that is configured with default values. Includes: ** Client Software Development Kit (CSDK) ** Java Database Connectivity (JDBC) Minimum disk space required: 700-800MB Custom: Install the database server with specific features and software that you need. Optionally install a configured database server instance. Minimum disk space required: 75 MB (without a server instance) ->1- Typical installation 2- Custom installation 3- Extract the product files (-DLEGACY option) 4- Create a RPM package for redistribution ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT:: =============================================================================== Server Instance Creation ------------------------ Create a server instance? ->1- Yes - create an instance 2- No - do not create an instance ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT:: =============================================================================== Configuration - Number of Users ------------------------------- Select the number of expected database users. ->1- 1 - 100 2- 101 - 500 3- 501 - 1000 4- 1000+ ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT:: =============================================================================== Ready To Install ---------------- InstallAnywhere is now ready to install GBase Software Bundle onto your system at the following location: /opt/hyq/3.5.0_2O2_for_iwa/ids PRESS <ENTER> TO INSTALL: =============================================================================== Installing... ------------- [==================|==================|==================|==================] [------------------|------------------|------------------|------------------] =============================================================================== Server Initialization --------------------- The server will now be initialized. Initialization might take quite a while, depending on the performance of your computer. PRESS <ENTER> TO CONTINUE: =============================================================================== Using the new instance ---------------------- A database server instance was created. If you chose to initialize the instance, it is ready to use. You can open a command prompt to an initialized instance by running one of the following commands at /opt/hyq/3.5.0_2O2_for_iwa/ids, where ol_gbasedbt1210_20240807102321 is the path or filename of the instance. Windows: ol_gbasedbt1210_20240807102321.cmd UNIX csh: source ol_gbasedbt1210_20240807102321.csh UNIX ksh or bourne: ./ol_gbasedbt1210_20240807102321.ksh If initialization fails, check the online.log file for messages. The instance's root chunk must be owned by the correct user and group, and it must have readable and writable (rw) permission bits set only for owner and group. PRESS <ENTER> TO CONTINUE: =============================================================================== Installation Complete --------------------- Congratulations! GBase Software Bundle installation is complete. Product install status: GBase: Successful GBase Connect: Successful GBase 8s V8.8 For more information about using GBase products, see the GBase Information Center at http://www.gbase.cn. PRESS <ENTER> TO EXIT THE INSTALLER: |
设定环境变量
需要设定环境变量,才能使用相关命令。
cd /opt/hyq/3.5.0_2O2_for_iwa/ids
source ol_gbasedbt1210_20240807102321.ksh
2、安装iwa
首先解压安装包:
tar xvf IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
进行安装,安装过程如下,蓝色部分是需要交互的。
[root@8s-225 setup]# ./iwa_install Preparing to install... Extracting the JRE from the installer archive... Unpacking the JRE... Extracting the installation resources from the installer archive... Configuring the installer for this system's environment... Launching installer... =============================================================================== GBase Warehouse Accelerator (created with InstallAnywhere) ------------------------------------------------------------------------------- Preparing CONSOLE Mode Installation... =============================================================================== Introduction ------------ InstallAnywhere will guide you through the installation of GBase Warehouse Accelerator. Copyright GBASE 2011, 2014. All rights reserved. Respond to each prompt to proceed to the next step in the installation. If you want to change something on a previous step, type 'back'. You may cancel this installation at any time by typing 'quit'. PRESS <ENTER> TO CONTINUE: =============================================================================== License Agreement ----------------- Installation and Use of GBase Warehouse Accelerator Requires Acceptance of the Following License Agreement: Thank you for choosing GBase product! Please read carefully the following licencing agreement before installing any product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS (COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE. BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS AGREEMENT. IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR ACCEPTANCE OF THESE TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY RETURN THE UNUSED SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND. 1. LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable license for the internal use only of the accompanying software and documentation and any error corrections provided by GeneralData(collectively "Software"), by the number of users and the class of computer hardware for which the corresponding fee has been paid. 2. RESTRICTIONS. Software is confidential and copyrighted. Title to Software PRESS <ENTER> TO CONTINUE: and all associated intellectual property rights is retained by GeneralData and/or its licensors. Except as specifically authorized in any Supplemental License Terms, you may not make copies of Software, other than a single copy of Software for archival purposes. Unless enforcement is prohibited by applicable law, you may not modify, decompile, or reverse engineer Software. You acknowledge that Software is not designed, licensed or intended for use in the design, construction, operation or maintenance of any nuclear facility. GeneralData disclaims any express or implied warranty of fitness for such uses. No right, title or interest in or to any trademark, service mark, logo or trade name of GeneralData or its licensors is granted under this Agreement. 3. DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of implied conditions, representations and warranties, including any implied warranty of merchantability, fitness for aparticular purpose or non-infringement are disclaimed, except to theextent that these disclaimers are held to be legally invalid. 4. LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event will GeneralData or its licensors be liable for any lost revenue, profit or data, or for special, indirect, consequential, incidental orpunitive damages, however caused regardless of the theory of liability, arising out of or related to the use of or inability to use software, even if GeneralData has PRESS <ENTER> TO CONTINUE: been advised of the possibility of such damages. In no event will GeneralData's libility to you, whether incontract, tort(including negligence), or otherwise, exceed the amount paid by you for Software under this Agreement. The foregoing limitations will apply even if the above stated warranty fails of itsessential purpose. 5. TERMINATION. This Agreement is effective until terminated. You may terminate this Agreement at any time by destroying all copies of Software. This Agreement will terminate immediately without noticefrom GeneralData if you fail to comply with any provision of this Agreement. Upon Termination, you must destroy all copies of Software. 6. EXPORT REGULATIONS. All Software and technical data delivered under this Agreement are subject to US export control laws and may be subject to export or import regulations in other countries. You agree to comply strictly with all such laws and regulations and acknowledge that you have the responsibility to obtain such licenses to export, re-export, or import as may be required after delivery to you. 7. CHINESE *RESTRICTED. If Software is being acquired by or on behalf PRESS <ENTER> TO CONTINUE: of the Chinese *, then the *rights in Software and accompanying documentation will be only as set forth in this Agreement. 8. GOVERNING LAW. Any action related to this Agreement will be governed by Chinese law: "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "COMPUTER SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF CHINA". No choice of law rules of any jurisdiction will apply." 9. SEVERABILITY. If any provision of this Agreement is held to be unenforceable, this Agreement will remain in effect with the provision omitted, unless omission would frustrate the intent of the parties, in which case this Agreement will immediately terminate. 10. INTEGRATION. This Agreement is the entire agreement between you and GeneralData relating to its subject matter. It supersedes all prior or contemporaneous oral or written communications, proposals, representations and warranties and prevails over any conflicting or additional terms of any quote, order, acknowledgment, or other communication between the parties relating to its subject matter during the term of this Agreement. No modification of this Agreement will be binding, unless in writing and signed by an authorize depresentative of each party. When the translation document has the different PRESS <ENTER> TO CONTINUE: meaning or has the conflicting views with Chinese original text conflict, should take the laws and regulations promulgation unit as well as the GeneralData issue Chinese original text as the standard. All trademarks and registered trademarks mentioned herein are the property of their respective owners. DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y =============================================================================== Installation Location --------------------- Where would you like to install GBase Warehouse Accelerator? Default Install Folder: /opt/ibm/gbasedbt ENTER AN ABSOLUTE PATH, OR PRESS <ENTER> TO ACCEPT THE DEFAULT : /opt/hyq/3.5.0_2O2_for_iwa/ids INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids IS THIS CORRECT? (Y/N): Y =============================================================================== Configuration choice -------------------- Would you like to configure GBase Warehouse Accelerator? 1- Yes ->2- No ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS <ENTER> TO ACCEPT THE DEFAULT:: =============================================================================== Pre-Installation Summary ------------------------ Please Review the Following Before Continuing: Product Name: GBase Warehouse Accelerator Install Folder: /opt/hyq/3.5.0_2O2_for_iwa/ids Product Features: GBase Warehouse Accelerator IWA storage directory /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo Starting port 21020 Number of nodes 2 Worker shared memory 500 Coordinator shared memory 250 Disk Space Information (for Installation Target): Required: 115,999,848 Bytes Available: 351,137,013,760 Bytes PRESS <ENTER> TO CONTINUE: =============================================================================== Installing... ------------- [==================|==================|==================|==================] [------------------|------------------|------------------|------------------] =============================================================================== Configuration file information ------------------------------ The installer has not configured the accelerator. A copy of the default configuration file for the accelerator is located at /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf. You should review and customize this file for your environment. PRESS <ENTER> TO CONTINUE: =============================================================================== Installation Complete --------------------- Congratulations. GBase Warehouse Accelerator has been successfully installed to: /opt/hyq/3.5.0_2O2_for_iwa/ids PRESS <ENTER> TO EXIT THE INSTALLER: |
3、配置ids
如果要使用iwa, 则ids的配置需要调整。
打开onconfig文件,
vi /opt/hyq/3.5.0_2O2_for_iwa/ids/etc/onconfig.ol_gbasedbt1210_20240807102321
加入如下内容:
VPCLASS dwavp,num=1,max=1,noage
然后重新启动ids。
onmode -ky
oninit -v
4、配置IWA
修改iwa的配置文件:
vi /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf
调整内容如下:
###################### # Set DWA Environent # ###################### # DWA storage directory # Stores the catalog, marts, logs, traces etc. DWADIR=/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo # Starting port number # Grows to START_PORT-1+NUM_NODES*4 . START_PORT=21020 # Number of nodes (DWA_CM processes) NUM_NODES=2 # Worker shared memory # SHM (in Megabyte) for all worker nodes. # Minimum value is 1 percent of physical memory. WORKER_SHM=100 # Coordinator shared memory # SHM (in Megabyte) for all coordinator nodes. # Minimum value is 1 percent of physical memory. COORDINATOR_SHM=100 # DRDA network interface # For running the accelerator on a separate computer ask the system # administrator for the network interface (e.g. eth0) that the GBasedbt # database server should connect to, or run the ifconfig command to find the # network interface. DRDA_INTERFACE=lo # Cluster network interface # For running the accelerator distributed on different nodes of a cluster ask # the system administrator for the network interface (e.g. eth0) that the # accelerator should use, or run the ifconfig command to find the network # interface. # Activate this parameter only to setup and start the accelerator on a cluster. # Prerequisits: # Use a cluster filesystem like GPFS to share the accelerator software and the # DWA storage directory DWADIR between the nodes of the accelerator. # Configure ssh login without password between all cluster nodes for user root. # Store a list of cluster nodes (hostnames), one node per line, in file # $GBASEDBTDIR/dwa/etc/cluster.conf #CLUSTER_INTERFACE=eth0 # CPU percentage for load specific threads # Calculates parameter CORES_FOR_LOAD_THREADS_PERCENTAGE which limits the # maximum number of threads that the load process is allowed to use for # building histograms and compressing cellblocks: # CORES_FOR_LOAD_THREADS_PERCENTAGE=CPU_PERCENTAGE_LOAD/NUM_NODES # On cluster CORES_FOR_LOAD_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_LOAD. CPU_PERCENTAGE_LOAD=100 # CPU percentage for scan specific threads # Calculates parameter CORES_FOR_SCAN_THREADS_PERCENTAGE which limits the # maximum number of threads per machine that the query engine is allowed to # use for scanning over cell block data: # CORES_FOR_SCAN_THREADS_PERCENTAGE=CPU_PERCENTAGE_SCAN/NUM_NODES # On cluster CORES_FOR_SCAN_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_SCAN. CPU_PERCENTAGE_SCAN=100 |
以上,通过本文的介绍,您应能了解IWA的基本概念和优势,并掌握了在GBase 8s中安装和配置IWA的基本步骤。IWA作为一种强大的内存数据仓库加速器,将为您的数据库应用带来性能提升。在下一篇中我们来谈谈IWA的具体使用。感谢您的阅读。
原文链接:https://www.gbase.cn/community/post/4242
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。