GlusterFS3.0新特性

蚊子今天上网,在glusterfs官方网站看到,glusterfs3.0版本在12月8号发布了,下面我们就来看看增加了那些新特性。

1) Self-heal of open files        打开文件的自修复

With this new feature GlusterFS can now self-heal replicated files even while they are op 
Servers can fail in replicated mode,  recover transparently i.e. have the files housed on th 
automatically self-healed.  The benefit of this feature is that Replicate use cases that also 
require files to remain open for extended periods, e.g. always open VM images, will wor 
better and be more reliable and available when a Replicate server fails and recovers.

2) Performance improvements in self heal       自修复过程的性能提升 

2.1) Choice of self-heal algorithms      自修复的算法选择 

During self-heal of file contents, GlusterFS will now dynamically choose between two 
algorithms based on file size:

a) "Full" algorithm – this algorithm copies the entire file data in order to heal the out-of- 
sync copy. This algorithm is used when a file has to be created from scratch on a 
server. 
b) "Diff" algorithm – this algorithm compares blocks present on both servers and copies 
only those blocks that are different from the correct copy to the out-of-sync copy. This 
algorithm is used when files have to be re-built partially. 
The “Diff” algorithm is especially beneficial for situations such as running VM images, 
where self-heal of a recovering replicated copy of the image will occur much faster because 
only the changed blocks need to be synchronized.

2.2) Background self-heal           后台自修复 
In GlusterFS 2.0.x, if self-healing is required e.g. when a failed Replicate server recovered, 
the first I/O command executed after recovery, such as a 'ls -l', that triggered the self-healing 
would block until the self-heal operation completed.  With v3.0, self-healing is now done in 
the background. Commands that can trigger self-healing will thus appear more responsive 
resulting in a better user experience.  Replicated VM images also benefit from this because 
they can continue to run even while the image is self-healed on  a failed server.

3) Stat-prefetch performance translator         状态预取性能模块 
Stat-prefetch is a new performance translator that pre-fetches directory entires and stat 
information.  The purpose of this translator is to optimize operations like 'ls -l', which 
generates a directory read followed by stat calls on each directory entry.  Overall 
performance of such commands will now be better due to directory entry stat being served 
from the cached pre-fetched stat data instead of triggering a network operation to obtain the 
stat information for that entry. 

4) Quick-read performance translator            快读性能模块 
Quick-read is a new performance translator that improves read performance on small files. 
Over a POSIX interface, files are read using the APIs lookup, open, read and close.  For a 
filesystem implemented over a network, the roundtrip overhead of these calls can be 
significant.  Quick-read reduces the network roundtrip overhead by delivering the file data 
for such small files to the client on the first operation (lookup) on the file, with subsequent 
read operations being served from the cached data.  Applications that involves lot of small 
files, such as webservers, source compliation will benefit noticably from using this 
translator.

5) I/O Cache   I/O缓存 
I/O cache translator has been enhanced to efficiently cache very large files (> 1GB).  All 
environments with large files, such as VM images, databases, genomics, 
animaition/rendering in which file sizes can easily be multi-GB in size, will benefit from 
this enhancement.

6) Direct FUSE device I/O           直接使用FUSE设备的I/O 
GlusterFS FUSE translator now can talk directly to the FUSE device without involving any 
data copying.  This leads to lower CPU utilization and better overall sysem performance. 
This enhancement removes the dependency/pre-requisite of having libfuse installed on the 
system for running, or building, GlusterFS.

7) Process Dump            进程转出 
Process Dump aggregates internal runtime information and writes it out into a file 
( /tmp/glusterdump.<pid> ).  Users can trigger it by sending the SIGUSR1 signal 
( kill -USR1 <pid> ) to a GlusterFS process.  You can use this feature to dump internal 
process information for debugging.  Process Dump is the first feature of the GTrace 
Framework, with additional features to follow. 

8) GlusterFS Volume Generator – Self optimized configuration    gluster配置文件生成工具 
GlusterFS Volume Generator (volgen) generates optimized volume configuration files for 
common workloads.  It is the recommended way to create GlusterFS volume configuration 
files.  By using volgen, users can quickly generate GlusterFS configuation files for their use 
case and avoid common configuration errors that can occur with hand coded configuration 
files. 
NOTE: Configurations generated outside the scope of volgen are neither recommended nor 
supported by Gluster.

9) Re-optimized Internal Datastructures       重新优化内部数据结构 
Large data structures inside GlusterFS have been reimplemented to use R-B-tree based hash 
tables.  This will help improve overall system performance.

  • 0
    点赞
  • 2
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
目标检测(Object Detection)是计算机视觉领域的一个核心问题,其主要任务是找出图像中所有感兴趣的目标(物体),并确定它们的类别和位置。以下是对目标检测的详细阐述: 一、基本概念 目标检测的任务是解决“在哪里?是什么?”的问题,即定位出图像中目标的位置并识别出目标的类别。由于各类物体具有不同的外观、形状和姿态,加上成像时光照、遮挡等因素的干扰,目标检测一直是计算机视觉领域最具挑战性的任务之一。 二、核心问题 目标检测涉及以下几个核心问题: 分类问题:判断图像中的目标属于哪个类别。 定位问题:确定目标在图像中的具体位置。 大小问题:目标可能具有不同的大小。 形状问题:目标可能具有不同的形状。 三、算法分类 基于深度学习的目标检测算法主要分为两大类: Two-stage算法:先进行区域生成(Region Proposal),生成有可能包含待检物体的预选框(Region Proposal),再通过卷积神经网络进行样本分类。常见的Two-stage算法包括R-CNN、Fast R-CNN、Faster R-CNN等。 One-stage算法:不用生成区域提议,直接在网络中提取特征来预测物体分类和位置。常见的One-stage算法包括YOLO系列(YOLOv1、YOLOv2、YOLOv3、YOLOv4、YOLOv5等)、SSD和RetinaNet等。 四、算法原理 以YOLO系列为例,YOLO将目标检测视为回归问题,将输入图像一次性划分为多个区域,直接在输出层预测边界框和类别概率。YOLO采用卷积网络来提取特征,使用全连接层来得到预测值。其网络结构通常包含多个卷积层和全连接层,通过卷积层提取图像特征,通过全连接层输出预测结果。 五、应用领域 目标检测技术已经广泛应用于各个领域,为人们的生活带来了极大的便利。以下是一些主要的应用领域: 安全监控:在商场、银行
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值