caffe：测试每一层的forward-backward时间

可以通过以下命令测试caffe网络每一层，前向传播，反向传播消耗用时，以分析网路性能。

./build/tools/caffe time --model=pose_deploy.prototxt --weights=pose_iter_584000.caffemodel --iterations=100 --gpu=0

--model 为网络prototxt文件，--weights 为相应训练好的模型，--iterations 为测试时迭代次数，--gpu 设置使用的gpu ,最后的测试结果为迭代次数下的均值。

测试结果示例如下：

.......
.......
.......
I0704 15:07:14.931399 11928 net.cpp:255] Network initialization done.
I0704 15:07:14.931879 11928 caffe.cpp:351] Performing Forward
I0704 15:07:14.976742 11928 caffe.cpp:356] Initial loss: 0
I0704 15:07:14.976781 11928 caffe.cpp:357] Performing Backward
I0704 15:07:14.976805 11928 caffe.cpp:365] *** Benchmark begins ***
I0704 15:07:14.976809 11928 caffe.cpp:366] Testing for 10 iterations.
I0704 15:07:15.084789 11928 caffe.cpp:394] Iteration: 1 forward-backward time: 107 ms.
I0704 15:07:15.167929 11928 caffe.cpp:394] Iteration: 2 forward-backward time: 83 ms.
I0704 15:07:15.234706 11928 caffe.cpp:394] Iteration: 3 forward-backward time: 66 ms.
I0704 15:07:15.301576 11928 caffe.cpp:394] Iteration: 4 forward-backward time: 66 ms.
I0704 15:07:15.368919 11928 caffe.cpp:394] Iteration: 5 forward-backward time: 67 ms.
I0704 15:07:15.436408 11928 caffe.cpp:394] Iteration: 6 forward-backward time: 67 ms.
I0704 15:07:15.503834 11928 caffe.cpp:394] Iteration: 7 forward-backward time: 67 ms.
I0704 15:07:15.571749 11928 caffe.cpp:394] Iteration: 8 forward-backward time: 67 ms.
I0704 15:07:15.639292 11928 caffe.cpp:394] Iteration: 9 forward-backward time: 67 ms.
I0704 15:07:15.706883 11928 caffe.cpp:394] Iteration: 10 forward-backward time: 67 ms.
I0704 15:07:15.706907 11928 caffe.cpp:397] Average time per layer: 
I0704 15:07:15.706913 11928 caffe.cpp:400]      input	forward: 0.0009 ms.
I0704 15:07:15.706919 11928 caffe.cpp:403]      input	backward: 0.0007 ms.
I0704 15:07:15.706925 11928 caffe.cpp:400]    conv1_1	forward: 0.2075 ms.
I0704 15:07:15.706949 11928 caffe.cpp:403]    conv1_1	backward: 0.1731 ms.
I0704 15:07:15.706955 11928 caffe.cpp:400]    relu1_1	forward: 0.0264 ms.
I0704 15:07:15.706959 11928 caffe.cpp:403]    relu1_1	backward: 0.0006 ms.
I0704 15:07:15.706964 11928 caffe.cpp:400]    conv1_2	forward: 1.4138 ms.
I0704 15:07:15.706967 11928 caffe.cpp:403]    conv1_2	backward: 0.9317 ms.
I0704 15:07:15.706971 11928 caffe.cpp:400]    relu1_2	forward: 0.0252 ms.
I0704 15:07:15.706974 11928 caffe.cpp:403]    relu1_2	backward: 0.0003 ms.
I0704 15:07:15.706979 11928 caffe.cpp:400] pool1_stage1	forward: 0.0487 ms.
I0704 15:07:15.706984 11928 caffe.cpp:403] pool1_stage1	backward: 0.0005 ms.
I0704 15:07:15.707006 11928 caffe.cpp:400]    conv2_1	forward: 0.7333 ms.
I0704 15:07:15.707011 11928 caffe.cpp:403]    conv2_1	backward: 0.4807 ms.
I0704 15:07:15.707017 11928 caffe.cpp:400]    relu2_1	forward: 0.0131 ms.
I0704 15:07:15.707022 11928 caffe.cpp:403]    relu2_1	backward: 0.0004 ms.
I0704 15:07:15.707028 11928 caffe.cpp:400]    conv2_2	forward: 1.4182 ms.
I0704 15:07:15.707033 11928 caffe.cpp:403]    conv2_2	backward: 0.981 ms.
I0704 15:07:15.707038 11928 caffe.cpp:400]    relu2_2	forward: 0.0131 ms.
I0704 15:07:15.707043 11928 caffe.cpp:403]    relu2_2	backward: 0.0005 ms.
I0704 15:07:15.707067 11928 caffe.cpp:400] pool2_stage1	forward: 0.0454 ms.
I0704 15:07:15.707073 11928 caffe.cpp:403] pool2_stage1	backward: 0.0006 ms.
I0704 15:07:15.707078 11928 caffe.cpp:400]    conv3_1	forward: 0.7827 ms.
I0704 15:07:15.707083 11928 caffe.cpp:403]    conv3_1	backward: 0.5503 ms.
I0704 15:07:15.707087 11928 caffe.cpp:400]    relu3_1	forward: 0.0069 ms.
I0704 15:07:15.707090 11928 caffe.cpp:403]    relu3_1	backward: 0.0008 ms.
I0704 15:07:15.707094 11928 caffe.cpp:400]    conv3_2	forward: 1.5794 ms.
I0704 15:07:15.707098 11928 caffe.cpp:403]    conv3_2	backward: 1.0782 ms.
I0704 15:07:15.707101 11928 caffe.cpp:400]    relu3_2	forward: 0.0073 ms.
I0704 15:07:15.707105 11928 caffe.cpp:403]    relu3_2	backward: 0.0009 ms.
I0704 15:07:15.707109 11928 caffe.cpp:400]    conv3_3	forward: 1.5337 ms.
I0704 15:07:15.707113 11928 caffe.cpp:403]    conv3_3	backward: 1.0784 ms.
I0704 15:07:15.707139 11928 caffe.cpp:400]    relu3_3	forward: 0.007 ms.
I0704 15:07:15.707144 11928 caffe.cpp:403]    relu3_3	backward: 0.0007 ms.
I0704 15:07:15.707147 11928 caffe.cpp:400]    conv3_4	forward: 1.5273 ms.
I0704 15:07:15.707151 11928 caffe.cpp:403]    conv3_4	backward: 1.1122 ms.
I0704 15:07:15.707155 11928 caffe.cpp:400]    relu3_4	forward: 0.007 ms.
I0704 15:07:15.707159 11928 caffe.cpp:403]    relu3_4	backward: 0.0006 ms.
I0704 15:07:15.707164 11928 caffe.cpp:400] pool3_stage1	forward: 0.063 ms.
I0704 15:07:15.707167 11928 caffe.cpp:403] pool3_stage1	backward: 0.0012 ms.
I0704 15:07:15.707170 11928 caffe.cpp:400]    conv4_1	forward: 1.1927 ms.
I0704 15:07:15.707175 11928 caffe.cpp:403]    conv4_1	backward: 1.0132 ms.
I0704 15:07:15.707178 11928 caffe.cpp:400]    relu4_1	forward: 0.004 ms.
I0704 15:07:15.707182 11928 caffe.cpp:403]    relu4_1	backward: 0.0024 ms.
I0704 15:07:15.707186 11928 caffe.cpp:400]    conv4_2	forward: 3.5343 ms.
I0704 15:07:15.707190 11928 caffe.cpp:403]    conv4_2	backward: 2.1107 ms.
I0704 15:07:15.707193 11928 caffe.cpp:400]   prelu4_2	forward: 0.0229 ms.
I0704 15:07:15.707197 11928 caffe.cpp:403]   prelu4_2	backward: 0.0165 ms.
I0704 15:07:15.707201 11928 caffe.cpp:400] conv4_3_CPM	forward: 2.0522 ms.
I0704 15:07:15.707206 11928 caffe.cpp:403] conv4_3_CPM	backward: 1.072 ms.
I0704 15:07:15.707209 11928 caffe.cpp:400] prelu4_3_CPM	forward: 0.0097 ms.
I0704 15:07:15.707213 11928 caffe.cpp:403] prelu4_3_CPM	backward: 0.0088 ms.
I0704 15:07:15.707217 11928 caffe.cpp:400] conv4_4_CPM	forward: 0.4445 ms.
I0704 15:07:15.707221 11928 caffe.cpp:403] conv4_4_CPM	backward: 0.3062 ms.
I0704 15:07:15.707224 11928 caffe.cpp:400] prelu4_4_CPM	forward: 0.0049 ms.
I0704 15:07:15.707228 11928 caffe.cpp:403] prelu4_4_CPM	backward: 0.0048 ms.
I0704 15:07:15.707232 11928 caffe.cpp:400] conv4_4_CPM_prelu4_4_CPM_0_split	forward: 0.0015 ms.
I0704 15:07:15.707237 11928 caffe.cpp:403] conv4_4_CPM_prelu4_4_CPM_0_split	backward: 0.0007 ms.
I0704 15:07:15.707240 11928 caffe.cpp:400] Mconv1_stage0_L2_0	forward: 0.14 ms.
I0704 15:07:15.707244 11928 caffe.cpp:403] Mconv1_stage0_L2_0	backward: 0.1066 ms.
I0704 15:07:15.707248 11928 caffe.cpp:400] Mprelu1_stage0_L2_0	forward: 0.0037 ms.
I0704 15:07:15.707252 11928 caffe.cpp:403] Mprelu1_stage0_L2_0	backward: 0.0048 ms.
I0704 15:07:15.707257 11928 caffe.cpp:400] Mconv1_stage0_L2_0_Mprelu1_stage0_L2_0_0_split	forward: 0.0002 ms.
I0704 15:07:15.707260 11928 caffe.cpp:403] Mconv1_stage0_L2_0_Mprelu1_stage0_L2_0_0_split	backward: 0.0008 ms.
I0704 15:07:15.707264 11928 caffe.cpp:400] Mconv1_stage0_L2_1	forward: 0.0864 ms.
I0704 15:07:15.707268 11928 caffe.cpp:403] Mconv1_stage0_L2_1	backward: 0.0814 ms.
I0704 15:07:15.707273 11928 caffe.cpp:400] Mprelu1_stage0_L2_1	forward: 0.0038 ms.
I0704 15:07:15.707275 11928 caffe.cpp:403] Mprelu1_stage0_L2_1	backward: 0.0045 ms.
I0704 15:07:15.707279 11928 caffe.cpp:400] Mconv1_stage0_L2_1_Mprelu1_stage0_L2_1_0_split	forward: 0.0008 ms.
I0704 15:07:15.707283 11928 caffe.cpp:403] Mconv1_stage0_L2_1_Mprelu1_stage0_L2_1_0_split	backward: 0.0007 ms.
I0704 15:07:15.707288 11928 caffe.cpp:400] Mconv1_stage0_L2_2	forward: 0.0794 ms.
I0704 15:07:15.707291 11928 caffe.cpp:403] Mconv1_stage0_L2_2	backward: 0.0806 ms.
I0704 15:07:15.707295 11928 caffe.cpp:400] Mprelu1_stage0_L2_2	forward: 0.004 ms.
I0704 15:07:15.707299 11928 caffe.cpp:403] Mprelu1_stage0_L2_2	backward: 0.0038 ms.
I0704 15:07:15.707304 11928 caffe.cpp:400] Mconv1_stage0_L2_concat	forward: 0.0017 ms.
I0704 15:07:15.707306 11928 caffe.cpp:403] Mconv1_stage0_L2_concat	backward: 0.0009 ms.
I0704 15:07:15.707310 11928 caffe.cpp:400] Mconv2_stage0_L2_0	forward: 0.3431 ms.
I0704 15:07:15.707314 11928 caffe.cpp:403] Mconv2_stage0_L2_0	backward: 0.2136 ms.
I0704 15:07:15.707319 11928 caffe.cpp:400] Mprelu2_stage0_L2_0	forward: 0.0046 ms.
I0704 15:07:15.707322 11928 caffe.cpp:403] Mprelu2_stage0_L2_0	backward: 0.0037 ms.
I0704 15:07:15.707326 11928 caffe.cpp:400] Mconv2_stage0_L2_0_Mprelu2_stage0_L2_0_0_split	forward: 0.0006 ms.
I0704 15:07:15.707330 11928 caffe.cpp:403] Mconv2_stage0_L2_0_Mprelu2_stage0_L2_0_0_split	backward: 0.0003 ms.
I0704 15:07:15.707339 11928 caffe.cpp:400] Mconv2_stage0_L2_1	forward: 0.079 ms.
I0704 15:07:15.707342 11928 caffe.cpp:403] Mconv2_stage0_L2_1	backward: 0.0757 ms.
I0704 15:07:15.707346 11928 caffe.cpp:400] Mprelu2_stage0_L2_1	forward: 0.0041 ms.
I0704 15:07:15.707351 11928 caffe.cpp:403] Mprelu2_stage0_L2_1	backward: 0.0038 ms.
I0704 15:07:15.707356 11928 caffe.cpp:400] Mconv2_stage0_L2_1_Mprelu2_stage0_L2_1_0_split	forward: 0.0008 ms.
I0704 15:07:15.707362 11928 caffe.cpp:403] Mconv2_stage0_L2_1_Mprelu2_stage0_L2_1_0_split	backward: 0.0004 ms.
I0704 15:07:15.707367 11928 caffe.cpp:400] Mconv2_stage0_L2_2	forward: 0.081 ms.
I0704 15:07:15.707373 11928 caffe.cpp:403] Mconv2_stage0_L2_2	backward: 0.0775 ms.
I0704 15:07:15.707378 11928 caffe.cpp:400] Mprelu2_stage0_L2_2	forward: 0.0039 ms.
I0704 15:07:15.707384 11928 caffe.cpp:403] Mprelu2_stage0_L2_2	backward: 0.0037 ms.
I0704 15:07:15.707389 11928 caffe.cpp:400] Mconv2_stage0_L2_concat	forward: 0.0015 ms.
I0704 15:07:15.707396 11928 caffe.cpp:403] Mconv2_stage0_L2_concat	backward: 0.0008 ms.
I0704 15:07:15.707401 11928 caffe.cpp:400] Mconv3_stage0_L2_0	forward: 0.3295 ms.
I0704 15:07:15.707406 11928 caffe.cpp:403] Mconv3_stage0_L2_0	backward: 0.2151 ms.
I0704 15:07:15.707412 11928 caffe.cpp:400] Mprelu3_stage0_L2_0	forward: 0.004 ms.
I0704 15:07:15.707417 11928 caffe.cpp:403] Mprelu3_stage0_L2_0	backward: 0.0037 ms.
I0704 15:07:15.707422 11928 caffe.cpp:400] Mconv3_stage0_L2_0_Mprelu3_stage0_L2_0_0_split	forward: 0.0009 ms.
I0704 15:07:15.707427 11928 caffe.cpp:403] Mconv3_stage0_L2_0_Mprelu3_stage0_L2_0_0_split	backward: 0.0006 ms.
I0704 15:07:15.707433 11928 caffe.cpp:400] Mconv3_stage0_L2_1	forward: 0.0826 ms.
I0704 15:07:15.707438 11928 caffe.cpp:403] Mconv3_stage0_L2_1	backward: 0.0767 ms.
I0704 15:07:15.707444 11928 caffe.cpp:400] Mprelu3_stage0_L2_1	forward: 0.0039 ms.
I0704 15:07:15.707449 11928 caffe.cpp:403] Mprelu3_stage0_L2_1	backward: 0.0045 ms.
I0704 15:07:15.707454 11928 caffe.cpp:400] Mconv3_stage0_L2_1_Mprelu3_stage0_L2_1_0_split	forward: 0.0008 ms.
I0704 15:07:15.707460 11928 caffe.cpp:403] Mconv3_stage0_L2_1_Mprelu3_stage0_L2_1_0_split	backward: 0.0006 ms.
I0704 15:07:15.707465 11928 caffe.cpp:400] Mconv3_stage0_L2_2	forward: 0.0852 ms.
I0704 15:07:15.707471 11928 caffe.cpp:403] Mconv3_stage0_L2_2	backward: 0.0762 ms.
I0704 15:07:15.707476 11928 caffe.cpp:400] Mprelu3_stage0_L2_2	forward: 0.0041 ms.
I0704 15:07:15.707482 11928 caffe.cpp:403] Mprelu3_stage0_L2_2	backward: 0.0037 ms.
I0704 15:07:15.707487 11928 caffe.cpp:400] Mconv3_stage0_L2_concat	forward: 0.0013 ms.
I0704 15:07:15.707494 11928 caffe.cpp:403] Mconv3_stage0_L2_concat	backward: 0.0009 ms.
I0704 15:07:15.707499 11928 caffe.cpp:400] Mconv4_stage0_L2_0	forward: 0.3359 ms.
I0704 15:07:15.707504 11928 caffe.cpp:403] Mconv4_stage0_L2_0	backward: 0.2233 ms.
I0704 15:07:15.707509 11928 caffe.cpp:400] Mprelu4_stage0_L2_0	forward: 0.0042 ms.
I0704 15:07:15.707515 11928 caffe.cpp:403] Mprelu4_stage0_L2_0	backward: 0.0038 ms.
I0704 15:07:15.707520 11928 caffe.cpp:400] Mconv4_stage0_L2_0_Mprelu4_stage0_L2_0_0_split	forward: 0.0006 ms.
I0704 15:07:15.707525 11928 caffe.cpp:403] Mconv4_stage0_L2_0_Mprelu4_stage0_L2_0_0_split	backward: 0.0005 ms.
I0704 15:07:15.707531 11928 caffe.cpp:400] Mconv4_stage0_L2_1	forward: 0.0819 ms.
I0704 15:07:15.707536 11928 caffe.cpp:403] Mconv4_stage0_L2_1	backward: 0.0838 ms.
I0704 15:07:15.707541 11928 caffe.cpp:400] Mprelu4_stage0_L2_1	fo