GlusterFS安装/配置/测试

操作系统 OpenSuse 10.2

1.下载

1) 下载GlusterFS

http://ftp.zresearch.com/pub/gluster/glusterfs/1.3/
http://europe.gluster.org/glusterfs/1.3/

2) 下载Fuse补丁

http://ftp.zresearch.com/pub/gluster/glusterfs/fuse/
http://europe.gluster.org/glusterfs/fuse/


2.安装

1) 安装Fuse
先安装kernel-source

#rpm -ivh kernel-source-2.6.18.2-34.i586.rpm

 

再安装Fuse

# tar -xzf fuse-2.7.2glfs8.tar.gz # cd fuse-2.7.2glfs8 # ./configure --prefix=/usr --enable-kernel-module # make install # ldconfig

 

2) 安装GlusterFS

# tar -xzf glusterfs-1.3.8pre1.tar.gz # cd glusterfs-1.3.8pre1 # ./configure --prefix= # make install

 

加上 --prefix= 后，配置文件会装在/etc下，否则配置文件装到/usr/local/etc/下

安装完成.

3) 配置 - 以2个server(172.16.0.191和172.16.0.192),1个client(172.16.0.193)为例

Server1 [172.16.0.191]

# cat /etc/glusterfs/glusterfs-server.vol volume brick type storage/posix option directory /data/export # Note: Once exported, DO NOT WRITE DIRECTLY TO THIS DIRECTORY end-volume volume brick-ns type storage/posix option directory /data/export-ns end-volume volume server type protocol/server subvolumes brick brick-ns option transport-type tcp/server # For TCP/IP transport option auth.ip.brick.allow * option auth.ip.brick-ns.allow * end-volume # glusterfsd -f /etc/glusterfs/glusterfs-server.vol # df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 5.0G 3.5G 1.2G 75% / udev 506M 64K 506M 1% /dev /dev/sda3 996M 18M 929M 2% /home

 

Server2 [172.16.0.192] 配置及操作同上.

Client1 [172.16.0.193] 配置

# mkdir /mnt/glusterfs # cat /etc/glusterfs/glusterfs-client.vol volume client1-ns type protocol/client option transport-type tcp/client option remote-host 172.16.0.191 option remote-subvolume brick-ns end-volume volume client1 type protocol/client option transport-type tcp/client option remote-host 172.16.0.191 option remote-subvolume brick end-volume volume client2 type protocol/client option transport-type tcp/client option remote-host 172.16.0.192 option remote-subvolume brick end-volume volume unify type cluster/unify subvolumes client1 client2 option namespace client1-ns option scheduler rr end-volume # glusterfs -f /etc/glusterfs/glusterfs-client.vol /mnt/glusterfs # df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 5.0G 4.2G 523M 90% / udev 247M 64K 247M 1% /dev /dev/sda3 996M 18M 929M 2% /home glusterfs 9.9G 8.0G 1.5G 85% /mnt/glusterfs

 

查看网络状态

# netstat -anp|grep glusterfs tcp 0 0 172.16.0.193:1016 172.16.0.191:6996 ESTABLISHED 13900/[glusterfs] tcp 0 0 172.16.0.193:1017 172.16.0.191:6996 ESTABLISHED 13900/[glusterfs] tcp 0 0 172.16.0.193:1015 172.16.0.192:6996 ESTABLISHED 13900/[gl

 

4. 测试

#in Client 1

#cp /root/test.txt /mnt/glusterfs/. #cp /root/test-1.txt /mnt/glusterfs/. #cp /root/test-2.txt /mnt/glusterfs/.

 

#in Client 1

# ll /mnt/glusterfs/ total 12 -rw-r--r-- 1 root root 20 Feb 28 23:50 test-1.txt -rw-r--r-- 1 root root 10 Feb 28 23:52 test-2.txt -rw-r--r-- 1 root root 20 Feb 28 23:42 test.txt

 

#in Server 1

# ll /data/export total 8 -rw-r--r-- 1 root root 20 Feb 28 23:50 test-1.txt -rw-r--r-- 1 root root 10 Feb 28 23:52 test-2.txt

 

#in Server 2

# ll /data/export/ total 4 -rw-r--r-- 1 root root 20 Feb 28 23:42 test.txt

 

安装，配置，测试成功。

继续高可靠性测试

#in Server 1

# killall -9 glusterfsd

 

#in Client 1

# ls /mnt/glusterfs/ ls: cannot access /mnt/glusterfs/: No such file or directory

 

说明当有Stoage Server DOWN时，整个cluster file system将不能使用。GlusterFS高可靠性配置可参考另一篇文章：


参考资料：
Install and run GlusterFS v1.3 in 10mins

性能优化：
Guide to Optimizing GlusterFS


附:

Self-Heal
Currently AFR doesn't do active self heal. That is, it won't fix all the inconsistencies automatically. But instead it fixes the inconsistencies when a file gets opened. Hence, if one needs to make sure all of his afr'd copies are in sync, following command may help.

$ find /mnt/glusterfs -type f -exec head -n 1 {} /;

 

A faster healing solution could be

$ find /mnt/glusterfs -type f -exec head -c 1 {} /; >/dev/null

 

转贴地址: http://anotherbug.blog.chinajavaworld.com/entry/4356/0/