人体姿态检测数据集Human3.6

w'xy

已于 2023-01-16 22:08:41 修改

阅读量2.4k

点赞数 4

分类专栏：数据集文章标签： python 深度学习

于 2023-01-16 09:42:48 首次发布

本文链接：https://blog.csdn.net/taylorman/article/details/128700525

版权

数据集专栏收录该内容

1 篇文章 0 订阅

订阅专栏

本文详细介绍了Human3.6m(h36m)数据集的获取方法，包括通过实验室申请和从网盘下载图像及标注数据。同时，文章提到了mmpose中h36m数据的格式要求，以及使用preprocess_h36m.py脚本进行数据预处理的步骤，包括解压缩、生成相机配置文件和注释文件。此外，还提及了CPN的2D检测数据和VideoPose3D数据格式的相关信息。

摘要由CSDN通过智能技术生成

Human3.6(h36m)

1.h36m数据的获取

1.1 以实验室的名义或者导师去官网申请或者发邮件，学生自己申请大概率申请不到

1.2 网盘资源(官网所有数据，很全！)

百度网盘请输入提取码

密码：j0ek

本地路径：G:\datasets\h36mv2\h36m

1.3 用下面这种方法下载的只有图像及其标注数据，无法获取 TOF 数据和 Segments 数据

# Download H36M annotations
mkdir data
cd data
wget http://visiondata.cis.upenn.edu/volumetric/h36m/h36m_annot.tar
tar -xf h36m_annot.tar
rm h36m_annot.tar
# Download H36M images
mkdir -p h36m/images
cd h36m/images
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S1.tar
tar -xf S1.tar
rm S1.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S5.tar
tar -xf S5.tar
rm S5.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S6.tar
tar -xf S6.tar
rm S6.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S7.tar
tar -xf S7.tar
rm S7.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S8.tar
tar -xf S8.tar
rm S8.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S9.tar
tar -xf S9.tar
rm S9.tar
wget http://visiondata.cis.upenn.edu/volumetric/h36m/S11.tar
tar -xf S11.tar
rm S11.tar
cd ../../..

本地路径：G:\datasets\h36m

2.mmpose里human3.6的数据格式

2.1 将官方数据（见1.2）整理成如下格式：

original
├── s1
|   ├── Videos.tgz
|   ├── D2_Positions.tgz
|   `── D3_Positions_mono.tgz
├── s2
...

2.2 调用`D:\mmpose\tools\dataset\preprocess_h36m.py`

python D:\mmpose\tools\dataset\preprocess_h36m.py --original G:\datasets\h36m_mmpose --metadata "G:\datasets\h36m_mmpose\metadata.xml"

2.2.0 fp50和fp10

The folder “50fps” will be generated automatically by running the preprocessing script with sample_rate=1. The default sample_rateis 5, which will result in 10fps annotations.


if __name__ == '__main__':
    args = parse_args()

    h36m = PreprocessH36m(
        metadata=args.metadata,
        original_dir=args.original,
        extracted_dir=args.extracted,
        processed_dir=args.processed,
        sample_rate=args.sample_rate)
    h36m.extract_tgz()
    h36m.generate_cameras_file()
    h36m.generate_annotations()

2.2.1 解压缩

2.2.2 生成相机pkl`"G:\datasets\processed\annotation_body3d\cameras.pkl”`

2.2.3 生成注释如2.3

2.3 mmpose里human3.6的数据格式

mmpose
├── mmpose
├── docs
├── tests
├── tools
├── configs
`── data
    ├── h36m
        ├── annotation_body3d
        |   ├── cameras.pkl
        |   ├── fps50
        |   |   ├── h36m_test.npz
        |   |   ├── h36m_train.npz
        |   |   ├── joint2d_rel_stats.pkl
        |   |   ├── joint2d_stats.pkl
        |   |   ├── joint3d_rel_stats.pkl
        |   |   `── joint3d_stats.pkl
        |   `── fps10
        |       ├── h36m_test.npz
        |       ├── h36m_train.npz
        |       ├── joint2d_rel_stats.pkl
        |       ├── joint2d_stats.pkl
        |       ├── joint3d_rel_stats.pkl
        |       `── joint3d_stats.pkl
        `── images
            ├── S1
            |   ├── S1_Directions_1.54138969
            |   |   ├── S1_Directions_1.54138969_00001.jpg
            |   |   ├── S1_Directions_1.54138969_00002.jpg
            |   |   ├── ...
            |   ├── ...
            ├── S5
            ├── S6
            ├── S7
            ├── S8
            ├── S9
            `── S11

https://github.com/open-mmlab/mmpose/issues/703

2.4 `cpn_ft_h36m_dbb_test.npy和cpn_ft_h36m_dbb_train.npy`

CPN 2D detections are provided by official repo. The reformatted version used in this repository can be downloaded from train_detection
and test_detection.

3. 数据集软连接

ln -s /media/wanglu/instillu/datasets/h36m /home/wanglu/mmpose/data/

4. VideoPose3D 数据格式

VideoPose3D/DATASETS.md at main · facebookresearch/VideoPose3D