python步态识别算法_译 | GaitSet：将步态作为序列的交叉视角步态识别（一）

本文是复旦大学发表于 AAAI 2019 的工作，截至目前CASIA-B正确率最高的网络。

英文粘贴原文，google参与翻译但人工为主，有不对的地方欢迎评论 ，部分为本人理解添加，非原文内容。

译 | 周悦媛

目录

摘要

1、介绍

Flexible 灵活性

Fast 快速性

Effective 有效性

2、相关工作

2.1 步态识别

2.2 无序序列的深度学习

3、GaitSet

3.1 问题表述

3.2 Set Pooling

Statistical Functions 统计函数

Joint Function 联合函数

Attention 注意力机制

3.3 Horizontal Pyramid Mapping

3.4 Multilayer Global Pipeline

3.5 训练和测试

训练损失函数

测试

4、实验

4.1 数据集和训练细节

CASIA-B

OU-MVLP

训练细节

4.2 主要结果

CASIA-B

Small-Sample Training (ST)

Medium-Sample Training (MT)

& Large-Sample Training (LT)

OU-MVLP

4.3 AblationExperiments 消融实验

Set VS. GEI

Impact of SP

Impact of HPM and MGP

4.4 Practicality 实用性

Limited Silhouettes 有限轮廓数量

MultipleViews 多视角

Multiple Walking Conditions

5、结论

「摘要」

As a unique biometric feature that can be recognized at a distance, gait has broad applications in crime prevention, forensic identification and social security.

作为一种可以远距离识别的独特生物识别功能，步态在预防犯罪，法医鉴定和社会保障方面具有广泛的应用。

To portray a gait, existing gait recognition methods utilize either a gait template, where temporal information is hard to preserve, or a gait sequence, which must keep unnecessary sequential constraints and thus loses the flexibility of gait recognition.

为了描绘步态，现有的步态识别方法利用步态模板(其中时间信息难以保存)或步态序列，其必须保持不必要的顺序约束并因此失去步态识别的灵活性。

In this paper we present a novel perspective, where a gait is regarded as a set consisting of independent frames. We propose a new network named GaitSet to learn identity information from the set.

在本文中，我们提出了一种新颖的视角，其中步态被视为由独立帧组成的(图像)序列。我们提出了一个名为GaitSet的新网络来学习(图像)序列中的身份信息。

Based on the set perspective, our method is immune to permutation of frames, and can naturally integrate frames from different videos which have been filmed under different scenarios, such as diverse viewing angles, different clothes/carrying conditions.

基于(图像)序列视角，我们的方法不受帧的排列的影响，并且可以自然地整合来自不同视频的帧，这些视频已经在不同的场景下被完成，例如不同的视角，不同的衣服/携带条件。

Experiments show that under normal walking conditions, our single-model method achieves an average rank-1 accuracy of 95.0% on the CASIAB gait dataset and an 87.1% accuracy on the OU-MVLP gait dataset.

实验表明，在正常步行条件下，我们的单模型方法在CASIAB步态数据集上实现了平均95.0％的一次命中准确度，在OU-MVLP步态数据集上达到了87.1％的准确度。

These results represent new state-of-the-art recognition accuracy.

这些结果代表了新的最先进的识别准确度。

On various complex scenarios, our model exhibits a significant level of robustness. It achieves accuracies of 87.2% and 70.4% on CASIA-B underbag-carrying and coat-wearing walking conditions, respectively.

在各种复杂场景中，我们的模型具有显着的鲁棒性。它分别对携带CARA-Bunderbag和涂层的行走条件达到了87.2％和70.4％的准确率。

These outperform the existing best methods by a large margin.

这些都大大优于现有的最佳方法。

The method presented can also achieve a satisfactory accuracy with a small number of frames in a test sample, e.g., 82.5% on CASIAB with only 7 frames.

所提出的方法可以在小帧数测试样本中获得令人满意的正确率，例如在CASIAB上仅用7帧得到82.5％的正确率。

「1」介绍

Unlike other biometrics such as face, fingerprint and iris, gait is a unique biometric feature that can be recognized at a distance without the cooperation of subjects and intrusion to them.Therefore,it has broad applications in crime prevention, forensic identification and social security.

与脸部，指纹和虹膜等其他生物识别技术不同，步态是一种独特的生物特征，可以远距离识别，非侵入且无需受试者的合作。因此，它被广泛应用于犯罪防范、法医鉴定和社会保障。

However, gait recognition suffers from exterior factors such as the subject’s walking speed, dressing and carrying condition, and the camera’s viewpoint and frame rate.

然而，步态识别受到外部因素的影响，例如受试者的步行速度，穿着和携带状况，以及相机的视点和帧速率。

There are two main ways to identify gait in literature,i.e.,regarding gait as an image and regarding gait as a video sequence. The first category compresses all gait silhouettes into one image, or gait template for gait recognition.

在文献中识别步态有两种主要方式，即将步态视为图像和将步态视为视频序列。第一类将所有步态轮廓压缩成一个图像，或用步态模板进行步态识别。"第一类典型代表典型代表GEI，如下图最后一列就是前几列图像的GEI，Gait Energy Image"

Simple and easy to implement, gait template easily loses temporal and fine-grained spatial information. Differently, the second category extracts features directly from the original gait silhouette sequences in recent years.

步态模板简单易行，但很容易丢失时间和细粒度的空间信息。不同的是，近几年第二类直接从原始步态轮廓序列中提取特征的算法更多。

However, these methods are vulnerable to exterior factors. Further, deep neural networks like3D-CNN for extracting sequential information are harder to train than those using a single template like Gait Energy