A Real-Time Fire Detection Method from Video with Multifeature Fusion 具有多特征融合的视频实时火灾检测方法 （论文翻译）

---

英文版论文原文：https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6664547/pdf/CIN2019-1939171.pdf

---

具有多特征融合的视频实时火灾检测方法

A Real-Time Fire Detection Method from Video with Multifeature Fusion
Faming Gong, Chuantao Li, Wenjuan Gong, Xin Li, Xiangbing Yuan, Yuhui Ma& Tao Song

• 中国石油大学计算机与通信工程系，青岛266580
• Department of Computer and Communication Engineering, China University of Petroleum, Qingdao 266580, China
• 中国石油化工股份有限公司胜利油田分公司海洋采油厂，山东东营
• China Petroleum and Chemical Corporation Shengli Oilfield Branch Ocean Oil Production Plant, Dongying, Shandong, China
• 马德里工业大学计算机科学学院人工智能系，西班牙博阿迪亚德尔蒙特，蒙特哥西多校园，28660马德里，西班牙
• Department of Artificial Intelligence, Faculty of Computer Science, Polytechnical University of Madrid, Campus de Montegancedo, Boadilla del Monte, 28660 Madrid, Spain

Abstract

火灾对人们的生命和财产构成的威胁日益严重。针对传统火灾探测中误报率高的问题，提出了一种基于火焰多特征融合的创新探测方法。首先，我们将火焰的运动检测和颜色检测结合起来作为火的预处理阶段。该方法节省了筛选候选火灾像素的大量计算时间。其次，尽管火焰是不规则的，但它在图像顺序方面具有一定的相似性。针对这一特点，提出了一种基于时空关系的火焰质心稳定算法，计算了图像各帧火焰区域的质心，并添加了时间信息，得到了火焰质心的时空信息。然后，我们提取了特征，包括火焰的空间变异性，形状变异性和面积变异性，以提高识别的准确性。最后，我们使用支持向量机进行训练，完成了候选火灾图像的分析，并实现了自动火灾监控。实验结果表明，与最新技术相比，该方法可以提高准确性，降低误报率。该方法可以应用于实时摄像机监视系统，例如家庭安全，森林火灾警报和商业监视。

The threat to people’s lives and property posed by fires has become increasingly serious. To address the problem of a high false alarm rate in traditional fire detection, an innovative detection method based on multifeature fusion of flame is proposed. First, we combined the motion detection and color detection of the flame as the fire preprocessing stage. This method saves a lot of computation time in screening the fire candidate pixels. Second, although the flame is irregular, it has a certain similarity in the sequence of the image. According to this feature, a novel algorithm of flame centroid stabilization based on spatiotemporal relation is proposed, and we calculated the centroid of the flame region of each frame of the image and added the temporal information to obtain the spatiotemporal information of the flame centroid. Then, we extracted features including spatial variability, shape variability, and area variability of the flame to improve the accuracy of recognition. Finally, we used support vector machine for training, completed the analysis of candidate fire images, and achieved automatic fire monitoring. Experimental results showed that the proposed method could improve the accuracy and reduce the false alarm rate compared with a state-of-the-art technique. The method can be applied to real-time camera monitoring systems, such as home security, forest fire alarms, and commercial monitoring.

1. Introduction

随着世界城市化进程的迅速发展，城市常住人口和人口密度都在增加。发生火灾时，它将严重威胁人们的生命，并造成重大经济损失。据不完全统计，2016年全国发生大火31.2万起，死亡1582人，受伤1065人，直接财产损失37.2亿美元[1、2]。 2019年3月和4月，世界各地发生了许多大型火灾事故，例如中国的凉山森林火灾，法国的巴黎圣母院火灾，意大利的森林火灾以及俄罗斯的草原火灾，造成了很大的火灾事故。损害人们的生命和财产。因此，火灾探测对于保护人们的生命和财产至关重要。当前城市中的检测方法依靠各种传感器进行检测[3-6]，包括烟雾警报器，温度警报器和红外线警报器。尽管这些警报可以起作用，但它们具有重大缺陷。首先，必须达到空气中一定浓度的颗粒才能触发警报。触发警报时，火势可能已经过强而无法控制，无法达到预警的目的。其次，大多数警报只能在封闭的环境中使用，而封闭的环境对于宽阔的空间（例如室外或公共场所）无效。第三，可能会有误报。当非火粒子浓度达到警报浓度时，将自动发出警报。人类无法干预并及时获取最新信息。

With the rapid spread of urbanization in the world, both the number of permanent residents in cities and the population density are increasing. When a fire occurs, it seriously threatens people’s lives and causes major economic losses. According to incomplete statistics, there were 312,000 fires in the country in 2016, with 1,582 people killed and 1,065 injured, and a direct property loss of 3.72 billion dollars [1, 2]. In March and April of 2019, there were many large-scale fire accidents around the world, such as forest fires in Liangshan, China, the Notre Dame fire in France, forest fires in Italy, and the grassland fire in Russia, which caused great damage to people’s lives and property. THerefore, fire detection is vitally important to protecting people’s lives and property. THe current detection methods in cities rely on various sensors for detection [3–6], including smoke alarms, temperature alarms, and infrared ray alarms. Although these alarms can play a role, they have major flaws. First, a certain concentration of particles in the air must be reached to trigger an alarm. When an alarm is triggered, a fire may already be too strong to control, defeating the purpose of early warning. Second, most of the alarms can only be functional in a closed environment, which is ineffective for a wide space, such as outdoors or public spaces. Third, there may be false alarms. When the nonfire particle concentration reaches the alarm concentration, it will automatically sound the alarm. Human beings cannot intervene and get the latest information in time.

为了防止火灾并阻碍火灾的迅速发展，有必要建立一个可以早期发现火灾的监控系统。 建立基于摄像机的火灾自动监控算法可以实现不间断的24/7全天候自动监控，从而大大降低了人工成本，城市监控系统的迅速普及为基于摄像机的火灾探测提供了基础[7]。 大大降低成本增加了这种系统的经济可行性。

To prevent fires and hinder their rapid growth, it is necessary to establish a monitoring system that can detect early fires. Establishing a camera-based automatic fire monitoring algorithm can achieve 24/7 automatic monitoring without interruption, which greatly reduces labor costs, and the rapid spread of urban monitoring systems provides the groundwork for camera-based fire detection [7]. Greatly reducing the cost increases the economic feasibility of such systems.

本文提出了一种基于火焰多特征的火灾检测方法，该方法首先将帧差检测[8]筛选出不移动的火象素与RGB颜色模型[9]结合起来。 在预处理模块中，帧差异检测操作迅速，并且不包含复杂的计算，对环境的要求较低，并且无需考虑时间，天气和其他因素。 另外，采用的RGB / HIS颜色模型相对稳定。 然后，考虑到空间变异性，面积变异性，边界复杂性和形状变异性，使用火焰像素点，凸包[10]和质心的数量确定火焰的特性。 最后，使用成熟的支持向量机进行验证。

This paper proposed a fire detection method based on the multifeatures of flame, which firstly combined frame difference detection [8] screening nonmoving fire pixels with RGB color model [9] screening nonfire color pixels. In the preprocessing module, the frame difference detection operates quickly and does not include complex calculations, has low environmental requirements, and does not need to consider the time of day, weather, and other factors. In addition, the adopted RGB/HIS color model is relatively stable. Then, taking into the account the spatial variability, the area variability, boundary complexity, and shape variability properties, the characteristics of the flame are determined by using the number of flame pixel points, the convex hull [10], and the centroid. Finally, a mature support vector machine is used for verification.

基于摄像机的火灾监控系统可以通过视频处理实时监控指定区域。 根据视频检测到火灾时，它将捕获的警报图像发送给管理员。 管理员根据提交的警报图像做出最终确认。 例如，当高速公路上发生事故并引起火灾时，根据检测算法传输的图像，人们可以立即营救受害者，从而节省了宝贵的时间并最大程度地减少了伤害。

The camera-based fire monitoring system can monitor the specified area in real time through video processing. When a fire is detected based on the video, it will send a captured alarm image to the administrator. The administrator makes a final confirmation based on the submitted alarm image. For example, when an accident occurs on a highway and causes a fire, based on the image transmitted by the detection algorithm, one can immediately rescue the victims, saving precious time and minimizing damage.

本文的主要贡献如下：（1）将基于帧差的运动检测与基于RGB / HSI模型的颜色检测相结合。颜色检测仅适用于完成运动检测阶段的运动区域。我们的方法提高了精度，减少了冗余计算。此外，我们还改进了帧差法。 （2）根据连续图像帧之间的空间相关性，我们改进了从一个单一图像帧检测火的传统方法。通过基于时空火焰质心稳定性的检测方法，时间形成与火焰特征结合在一起。同时，我们结合了在火灾预处理阶段获得的数据，以减少计算冗余和计算复杂度。 （3）我们提取了各种火焰特征，空间变异性，形状变异性和面积变异性。我们使用支持向量机进行训练，完成最终验证，降低误报率和误报率，并提高准确性。

The main contributions of this paper are as follows: (1) We combine motion detection based on frame difference with color detection based on the RGB/HSI model. Color detection is only for regions of motion that the motion detection phase is completed. Our method has improved the precision and reduced redundant calculation. In addition, we have improved the frame difference method. (2) According to the spatial correlation between consecutive image frames, we have improved the traditional methods of detecting fire from one single image frame. Temporal information is combined with the flame features through a space-time flame centroid stability-based detection method. At the same time, we combine the data obtained during the fire preprocessing phase to reduce computational redundancy and computational complexity. (3) We extracted various flame features, spatial variability, shape variability, and area variability. We used the support vector machine to train, complete the final verification, reduce the false negatives rate and false positives rate, and improve the accuracy.

2. Related Works

对于火灾探测，传统方法是使用传感器进行探测。 缺陷之一是错误率高，因为触发警报基于颗粒的浓度或周围温度，因此很容易受到周围环境的干扰。 同时，这种方法无法得知火灾的位置和实时状态。 对于有明显火灾危险的室外场景，这种类型的传感器无法提供有效的检测。 由于传统火灾识别中存在许多问题，如何准确识别火灾已引起了广泛的关注。 因此，火灾探测在火灾探测传感器的方向，检测设备的改进以及基于视频图像的火灾探测方面已实现了快速发展。

For fire detection, the traditional method is to use a sensor for detection. One of the defects is the high false rate becausethe trigger alarm is based on the concentration of particles or the surrounding temperature and is therefore easily disturbed by the surroundings. At the same time, this method cannot know the location and the real-time status of the fire. For outdoor scenes, which are notable fire hazards, this type of sensor cannot provide effective detection. Due to the many problems in traditional fire identification, how to accurately identify the fire has received great attention. Therefore, fire detection has achieved rapid development in the direction of fir