使用Motion-Vector实现Real-time人体行为识别

导言:由上一篇博客的方法实现人体行为识别,准确率高,但缺陷在于速度慢,最大的原因在于经典的two-stream的人体行为识别均使用光流图作为temporal net的输入。光流法速度慢,在应用中无法实时。

这篇博客引用论文

Real-time Action Recognition with Enhanced Motion Vector CNNs——–Bowen Zhang, Limin Wang, Zhe Wang, Yu Qiao, Hanli Wang

MotionVector来替代optical flow可以极大的提升速度。MotionVector原本用于视频压缩,以便视频传输到指定端后解压。论文中使用MotionVector作为运动特征来使用。但是速度快带来的缺陷是图片精度低,与光流图的点状形式存在不同,运动向量图以块状存在,因此图片不清楚,噪声多,势必带来识别准确率的下降。
该网络的核心思想是通过使用optical flow训练好的OF-CNN指导MV-CNN的训练。该transfer knowledge思想来自于Hinton大神的一篇论文:

Distilling the knowledge in neural network

  • 5
    点赞
  • 9
    收藏
    觉得还不错? 一键收藏
  • 4
    评论
利用骨骼进行的人体行为识别, 基于LOP 的行为识别,可以运行 (action recognition) 文件列表: actionletEnsemble-master actionletEnsemble-master\.gitignore actionletEnsemble-master\LICENSE actionletEnsemble-master\MSRAction3D actionletEnsemble-master\MSRAction3D\MSRAction3D_skeleton_features.mat actionletEnsemble-master\MSRAction3D\evaluate_on_MSR_action_3D.m actionletEnsemble-master\MSRDailyActivity3D actionletEnsemble-master\MSRDailyActivity3D\configDailyAcitity.m actionletEnsemble-master\MSRDailyActivity3D\evaluate_on_MSR_DailyAcitivity3D.m actionletEnsemble-master\MSRDailyActivity3D\extractAllLopFeatures.m actionletEnsemble-master\MSRDailyActivity3D\extractAllSkeletonFeatures.m actionletEnsemble-master\MSRDailyActivity3D\processOneSkeleton.m actionletEnsemble-master\MSRDailyActivity3D\trainClassifier.m actionletEnsemble-master\README.md actionletEnsemble-master\feature actionletEnsemble-master\feature\computeMotionField.m actionletEnsemble-master\feature\computePairwiseJointPositions.m actionletEnsemble-master\feature\computeSOPFeaturesSkeleton.m actionletEnsemble-master\feature\compute_motion_descriptors.m actionletEnsemble-master\feature\compute_motion_maps.m actionletEnsemble-master\feature\fftPyramid.m actionletEnsemble-master\feature\getSopFeature.m actionletEnsemble-master\feature\lopFeature.m actionletEnsemble-master\feature\lopFeatureSkeleton.m actionletEnsemble-master\feature\sopFeatureSkeleton.m actionletEnsemble-master\setup_path.m actionletEnsemble-master\util actionletEnsemble-master\util\ComputeMotion.mexw64 actionletEnsemble-master\util\ReadDepthBin.mexa64 actionletEnsemble-master\util\ReadDepthBin.mexw64 actionletEnsemble-master\util\iSaveX.m actionletEnsemble-master\util\normalizeFeature.m actionletEnsemble-master\util\predict.mexa64 actionletEnsemble-master\util\readDepthBin.m actionletEnsemble-master\util\readSkeleton.m actionletEnsemble-master\util\train.mexa64

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论 4
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值