linux的hugepage的配置

 

linux的hugepage的配置

2013-01-22 17:13  3244人阅读  评论(0)  收藏  举报

版权声明：本文为博主原创文章，未经博主允许不得转载。

由于Linux的特性，linux使用内存的方式是采用vm的方式，即linux把物理内存和swap共同虚拟成
内存来对外提供，有时用户看似使用内存，可实际上是使用磁盘，那如何避免使用swap磁盘空间呢？

linux管理内存的单位是页(pages),一般情况下是4k的page，当我们使用的大内存时(>8G),管理这么大的内存
就会给系统造成很大的负担，再加上频繁的pagein/pageout，会成为系统的瓶颈，所以我们一般都要配置hugepage。

配置了之后,Linux对大页面内存的引入对减少TLB的失效效果不错，特别是内存大而密集型的程序，比如说在数据库中的使用,下面是实际的例子

说明在Oracle实际库的配置方法：

MySQL服务器参考:http://www.cyberciti.biz/tips/linux-hugetlbfs-and-mysql-performance.html  

(1) 配置之前

[oracle@db101 ~]$ grep -i hu /proc/meminfo
VmallocChunk: 34359467367 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB


(2) 首先修改limits.conf
[root@db101 ~]# vi /etc/security/limits.conf  略小于总内存
##daodao add  0122
*   soft   memlock    15826672
*   hard   memlock    15826672
[oracle@db101 ~]$ ulimit -l  --检查刚才的执行是否生效
15826672
(3).确定所有的oracle数据库实例都启动,包括asm实例，然后用如下脚本计算参数“vm.nr_hugepages"的大小
------------------hugepages_settings.sh----------------------------
#!/bin/bash
#
# hugepages_settings.sh
#
# Linux bash script to compute values for the
# recommended HugePages/HugeTLB configuration
#
# Note: This script does calculation for all shared memory
# segments available when the script is run, no matter it
# is an Oracle RDBMS shared memory segment or not.
#
# This script is provided by Doc ID 401749.1 from My Oracle Support 
# http://support.oracle.com
# Welcome text
echo "
This script is provided by Doc ID 401749.1 from My Oracle Support 
(http://support.oracle.com) where it is intended to compute values for
the recommended HugePages/HugeTLB configuration for the current shared 
memory segments. Before proceeding with the execution please make sure 
that:
 * Oracle Database instance(s) are up and running
 * Oracle Database 11g Automatic Memory Management (AMM) is not setup 
   (See Doc ID 749851.1)
 * The shared memory segments can be listed by command:
     # ipcs -m
Press Enter to proceed..."
read
# Check for the kernel version
KERN=`uname -r | awk -F. '{ printf("%d.%d\n",$1,$2); }'`
# Find out the HugePage size
HPG_SZ=`grep Hugepagesize /proc/meminfo | awk '{print $2}'`
# Initialize the counter
NUM_PG=0
# Cumulative number of pages required to handle the running shared memory segments
for SEG_BYTES in `ipcs -m | awk '{print $5}' | grep "[0-9][0-9]*"`
do
   MIN_PG=`echo "$SEG_BYTES/($HPG_SZ*1024)" | bc -q`
   if [ $MIN_PG -gt 0 ]; then
      NUM_PG=`echo "$NUM_PG+$MIN_PG+1" | bc -q`
   fi
done
RES_BYTES=`echo "$NUM_PG * $HPG_SZ * 1024" | bc -q`
# An SGA less than 100MB does not make sense
# Bail out if that is the case
if [ $RES_BYTES -lt 100000000 ]; then
   echo "***********"
   echo "** ERROR **"
   echo "***********"
   echo "Sorry! There are not enough total of shared memory segments allocated for
HugePages configuration. HugePages can only be used for shared memory segments 
that you can list by command:
   # ipcs -m
of a size that can match an Oracle Database SGA. Please make sure that:
 * Oracle Database instance is up and running 
 * Oracle Database 11g Automatic Memory Management (AMM) is not configured"
   exit 1
fi
# Finish with results
case $KERN in
   '2.4') HUGETLB_POOL=`echo "$NUM_PG*$HPG_SZ/1024" | bc -q`;
          echo "Recommended setting: vm.hugetlb_pool = $HUGETLB_POOL" ;;
   '2.6') echo "Recommended setting: vm.nr_hugepages = $NUM_PG" ;;
    *) echo "Unrecognized kernel version $KERN. Exiting." ;;
esac
# End


使用oracle用户执行sh脚本
[oracle@db101 ~]$ sh hugepages_settings.sh


This script is provided by Doc ID 401749.1 from My Oracle Support 
(http://support.oracle.com) where it is intended to compute values for
the recommended HugePages/HugeTLB configuration for the current shared 
memory segments. Before proceeding with the execution please make sure 
that:
 * Oracle Database instance(s) are up and running
 * Oracle Database 11g Automatic Memory Management (AMM) is not setup 
   (See Doc ID 749851.1)
 * The shared memory segments can be listed by command:
     # ipcs -m
Press Enter to proceed...


Recommended setting: vm.nr_hugepages = 2562


(4)切换root用户修改sysctl.conf
[root@db101 ~]$ vi  /etc/sysctl.conf 


net.ipv4.ip_local_port_range = 1024 65000
net.core.rmem_default = 262144
net.core.rmem_max = 262144
net.core.wmem_default = 262144
net.core.wmem_max = 262144
vm.nr_hugepages = 2562     --这一行是新加的

(5)关闭所有实例，然后重启服务器

(6)[root@db101 ~]# grep -i hu /proc/meminfo
VmallocChunk: 34359467239 kB
HugePages_Total:  2562
HugePages_Free:   2562
HugePages_Rsvd:      0
Hugepagesize:     2048 kB


hugepage已经生效