GPFS在Linux下安装过程简述

1.安装GPFS包

#rpm –ivh *.rpm
(gpfs.base-3.1.0-1.x86_64,gpfs.docs-3.1.0-1.noarch,gpfs.gpl-3.1.0-1.noarch,gpfs.msg.en_US-3.1.0-1.noarch)
2. 安装GPFS升级包

rpm –Uvh *.rpm
(gpfs.base-3.1.0-8.x86_64,gpfs.docs-3.1.0-8.noarch,gpfs.gpl-3.1.0-8.noarch,gpfs.msg.en_US-3.1.0-8.noarch)

3. 编译

#cd /usr/lpp/mmfs/src/config
#cp site.mcr.proto site.mcr 
#vi site.mcr
参考 README 修改site.mcr
#cd /usr/lpp/mmfs/src
#export SHARKCLONEROOT=/usr/lpp/mmfs/src
#make Autoconfig
#make InstallImages
#cd /usr/lpp/mmfs/bin

/* Copy bin files to all the other nodes */

4. 系统优化：

mmchconfig pagepool=1000M （4M－1/2内存总量）
mmchconfig maxFilesToCache ＝1700（default,1-100000）
maxStatCache (4 × maxFilesToCache )
Aggregate network interfaces 
Swap space (2 x total of mem)

updatedb considerations (skip gpfs) important

Suggested starting points are: 
mmchconfig prefetchThreads=18
mmchconfig worker1Threads=24 

Verify /proc/sys/net/ipv4/tcp_window_scaling is enabled. It should be by default. 

Tune the TCP window settings by adding these lines to the /etc/sysctl.conf file:
# increase Linux TCP buffer limits 
net.core.rmem_max = 8388608 
net.core.wmem_max = 8388608 
# increase default and maximum Linux TCP buffer sizes 
net.ipv4.tcp_rmem = 4096 262144 8388608 
net.ipv4.tcp_wmem = 4096 262144 8388608 
# increase max backlog to avoid dropped packets 
net.core.netdev_max_backlog=2500 

A. Issue the sysctl -p /etc/sysctl.conf command to set the kernel settings. 
B. Issue the mmstartup -a command to restart GPFS 


5 .创建GPFS集群

#/usr/lpp/mmfs/bin/mmcrcluster -t lc -p io1 -s io2 -n
/tmp/gpfs.nodes -r /usr/bin/ssh -R /usr/bin/scp
List the GPFS cluster details using:
#/usr/lpp/mmfs/bin/mmlscluster

6. 启动 GPFS
mmstartup -a

7. 磁盘定义
cat /tmp/gpfs.disks
/dev/sda:io1::dataAndMetadata:-1
/dev/sdb:io2::dataAndMetadata:-1
....
#cp /tmp/gpfs.disks /tmp/gpfs.disks.bak
#/usr/lpp/mmfs/bin/mmcrnsd -F /dump/gpfs.disks -v yes
#mmlsnsd

8.创建GPFS文件系统
# mmcrfs /gpfs1 gpfs1 -F /tmp/gpfs.disks1 -A yes

9.增加GPFS客户端
#mmaddnode -N node1
#mmaddnode -N node2