SlowFastNet github(最近放出来的):
https://github.com/facebookresearch/SlowFast
配置环境要求:
https://github.com/facebookresearch/SlowFast/blob/master/INSTALL.md
这里的两个包PyAv和fvcore比较不好装;
fvcore的github上推荐的是使用pip install ‘git+https://github.com/facebookresearch/fvcore’,但由于加密系统的问题,git用不了;所以只能下载下来,解压后进入文件夹使用python setup.py install指令通过编译来安装;
PyAv使用推荐的conda install av -c conda-forge出现了段错误,段错误解决具体参考我另一篇https://blog.csdn.net/weixin_42388228/article/details/102882607;同样这里也可以使用先下载下来再python setup.py install来安装,这样安装会报错误,查了下PyAv github里issue列表是因为缺少一些依赖,具体参考我另一篇https://blog.csdn.net/weixin_42388228/article/details/102817959;
这样安装就完事了
权重文件:
https://github.com/facebookresearch/SlowFast/blob/master/MODEL_ZOO.md
我下载的kinetics中的倒数第三个SLOWFAST_8x8_R50,最后两个暂时还没提供
坑1:
使用权重文件对应的yaml文件时,是用…/SlowFast-master/configs/Kinetics/SLOWFAST_8x8_R50.yaml来配置config,还需参考…/SlowFast-master/configs/Kinetics/c2/SLOWFAST_8x8_R50.yaml文件更改第一个yaml文件。(有一处改动,kernel_size)
坑2:
slowfast的输入为一个list,list第一个元素的shape为[batch_size,3,8,224,224],第二个元素的shape为[batch_size,3,32,224,224]
坑3:
我这的实现在yaml文件中修改了gpu个数为1
import sys
sys.path.append('.../SlowFast-master/slowfast/config/')
sys.path.append('.../SlowFast-master/slowfast/models/')
sys.path.append('.../SlowFast-master/slowfast/utils/')
import slowfast.models.optimizer as optim
import slowfast.utils.checkpoint as cu
from defaults import _C
from model_builder import _MODEL_TYPES
from slowfast.models import model_builder
from slowfast.utils.c2_model_loading import get_name_convert_func
import torch
import torch.nn as nn
import os
import cv2
import numpy as np
import pickle
import yaml
torch.cuda.set_device(7)
########################################### data preparation ###########################################
data1,label=data4file(batch_size=32,stride