NFS、PVFS和Lustre文件系统的安装和性能评测

本文对比分析了NFS、PVFS和Lustre三种高性能分布式文件系统在安装配置、核心特性和适用场景方面的差异。详细介绍了在Redhat和Ubuntu环境下NFS、PVFS的安装步骤,并阐述了Lustre作为高性能并行文件系统的优越性,包括其克服传统分布式文件系统性能低、可靠性差、规模小的问题。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

如今,面向网络的计算环境需要一种高性能、网络化的文件系统,这种文件系统既可满足个人的存储需求又可满足集群系统的文件共享需求。在实际应用中,NFS、PVFS文件系统越来越不能满足大规模计算需求。Lustre是一种高性能并行文件系统,它克服了传统分布式文件系统中性能低、可靠性差、规模小等问题。现通过在同一环境下分别安装NFS、PVFS和Lustre文件系统,然后评测它们的性能。其中在不同系统下的安装方法是不同的,在redhat下可通过rpm来安装,比较简单;在ubuntu下则有点复杂。
    一:NFS PVFS Lustre安装和配置
 
        1.NFS
l 服务器端:
apt-get install portmap
apt-get install nfs-user-server
apt-get install nfs-kernel-server
服务
/etc/init.d/portmap start
/etc/init.d/nfs-user-server start
/etc/init.d/nfs-kernel-server start
l 服务器端:
#vi /etc/exports 客户端:
#vi /etc/fstab         安装
下载 Berkeley DB(version 3 or 4)
aio support(provided by glibc and librt)
gcc 2.96 or newer
PVFS官网下载 PVFS-2.7.1.tar.gz make 注意:在安装 PVFS 编译器的版本是否大于或等于 2.96 ,这说明你虽然安装 db-xx.tar.gz 安装手册要求安装 GNU 启动服务器: #/usr/sbin/pvfs2-server /etc/pvfs2-fs.conf –f
                             #/usr/sbin/pvfs2-server /etc/pvfs2-fs.conf
                             #/etc/rc.d/init.d/pvfs2-server start
        注意:在实际的安装中, PVFS /usr/local/bin 中。所以上面的目录对于有些机器是不一样的,在使用中可以去除目录直接使用命令即可。 pvfs2-genconfig local name 地址。
 
(1)(2)  给Linux(3)下载Linuxlinux-source-2.6.18.tar.gzmake mrproper(9)#(10)#     
#modprobe ldiskfsPVFS:静态配置,不能动态扩展
NFS:  “信任网络”<span times="" new="" roman';="" mso-hansi-font-family:="" 'times="" roman'"="" style="padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font-size: 12pt; ">
PVFS:数据无容错机制
Lustre:MDS、OST、Client构成高级安全框架
Lustre is a shared disk file system, generally used for large scale cluster computing. The name Lustre is a portmanteau of Linux and cluster. The project aims to provide a file system for clusters of tens of thousands of nodes with petabytes of storage capacity, without compromising speed or security. Lustre is available under the GNU GPL.Lustre is designed, developed and maintained by Sun Microsystems, Inc. with input from many other individuals and companies. Sun completed its acquisition of Cluster File Systems, Inc., including the Lustre file system, on October 2, 2007, with the intention of bringing the benefits of Lustre technologies to Sun's ZFS file system and the Solaris operating system.Lustre file systems are used in computer clusters ranging from small workgroup clusters to large-scale, multi-site clusters. Fifteen of the top 30 supercomputers in the world use Lustre file systems, including the world's fastest supercomputer, the Blue Gene/L at Lawrence Livermore National Laboratory (LLNL). Other supercomputers that use the Lustre file system include systems at Oak Ridge National Laboratory, Pacific Northwest National Laboratory, and Los Alamos National Laboratory in North America, the largest system in Asia at Tokyo Institute of Technology, and the largest system in Europe at CEA.Lustre file systems can support up to tens of thousands of client systems, petabytes (PBs) of storage and hundreds of gigabytes per second (GB/s) of I/O throughput. Businesses ranging from Internet service providers to large financial institutions deploy Lustre file systems in their datacenters. Due to the high scalability of Lustre file systems, Lustre deployments are popular in the oil and gas, manufacturing, rich media and finance sectors.
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值