caffe一些小知识点-caffe层的时间测试(cpu-gpu)

今天测试MobileNetV3

CPU:

./build/tools/caffe time -model models/mobilenet_v3/mobilenet_v3_large_1.0.prototxt

GPU:

./build/tools/caffe time -model models/mobilenet_v3/mobilenet_v3_large_1.0.prototxt -gpu 0


./build/tools/caffe time -model models/mobilenet_v3/mobilenet_v3_large_1.0.prototxt -gpu 0 2>&1 | tee log.txt

下面这个表是用别人的： 

### Performance on MobileNetV3
| Backbone            | CPU-Forward | CPU-Backward | GPU-Forward | GPU-Backward |
| ------------------- |:---------:  | :---------:  | :---------: | :---------:  |
| V3-Large 1.0        |  134.55 ms  |  140.23 ms   |  15.44 ms   |   21.79 ms   |
| V3-Small 1.0        |  58.64  ms  |  59.30  ms   |  11.49 ms   |   12.58 ms   |

发现只要是deploy.prototxt就可以测试时间

开头必须是：

name: "CaffeNet"
layer {
  name: "data"
  type: "Input"
  top: "data"
  input_param { shape: { dim: 10 dim: 3 dim: 227 dim: 227 } }
}

或者：

name: "mobilenet v3"
input: "data"
input_dim: 1
input_dim: 3
input_dim: 224
input_dim: 224

I0530 10:00:44.347740  4252 net.cpp:270] This network produces output prob
I0530 10:00:44.347756  4252 net.cpp:283] Network initialization done.
I0530 10:00:44.347813  4252 caffe.cpp:355] Performing Forward
I0530 10:00:44.377192  4252 caffe.cpp:360] Initial loss: 0
I0530 10:00:44.377218  4252 caffe.cpp:361] Performing Backward
I0530 10:00:44.377223  4252 caffe.cpp:369] *** Benchmark begins ***
I0530 10:00:44.377225  4252 caffe.cpp:370] Testing for 50 iterations.
I0530 10:00:44.392259  4252 caffe.cpp:398] Iteration: 1 forward-backward time: 15.0047 ms.
I0530 10:00:44.403524  4252 caffe.cpp:398] Iteration: 2 forward-backward time: 11.1985 ms.
I0530 10:00:44.414067  4252 caffe.cpp:398] Iteration: 3 forward-backward time: 10.5062 ms.
I0530 10:00:44.425256  4252 caffe.cpp:398] Iteration: 4 forward-backward time: 11.1688 ms.
I0530 10:00:44.436049  4252 caffe.cpp:398] Iteration: 5 forward-backward time: 10.7636 ms.
I0530 10:00:44.446496  4252 caffe.cpp:398] Iteration: 6 forward-backward time: 10.4291 ms.
I0530 10:00:44.457666  4252 caffe.cpp:398] Iteration: 7 forward-backward time: 11.1524 ms.
I0530 10:00:44.468365  4252 caffe.cpp:398] Iteration: 8 forward-backward time: 10.678 ms.
I0530 10:00:44.478878  4252 caffe.cpp:398] Iteration: 9 forward-backward time: 10.495 ms.
I0530 10:00:44.490145  4252 caffe.cpp:398] Iteration: 10 forward-backward time: 11.2486 ms.
I0530 10:00:44.500825  4252 caffe.cpp:398] Iteration: 11 forward-backward time: 10.6591 ms.
I0530 10:00:44.511317  4252 caffe.cpp:398] Iteration: 12 forward-backward time: 10.4745 ms.
I0530 10:00:44.522455  4252 caffe.cpp:398] Iteration: 13 forward-backward time: 11.1208 ms.
I0530 10:00:44.533102  4252 caffe.cpp:398] Iteration: 14 forward-backward time: 10.6268 ms.
I0530 10:00:44.543633  4252 caffe.cpp:398] Iteration: 15 forward-backward time: 10.5147 ms.
I0530 10:00:44.554941  4252 caffe.cpp:398] Iteration: 16 forward-backward time: 11.2906 ms.
I0530 10:00:44.565413  4252 caffe.cpp:398] Iteration: 17 forward-backward time: 10.4543 ms.
I0530 10:00:44.575683  4252 caffe.cpp:398] Iteration: 18 forward-backward time: 10.2533 ms.
I0530 10:00:44.586406  4252 caffe.cpp:398] Iteration: 19 forward-backward time: 10.7059 ms.
I0530 10:00:44.596909  4252 caffe.cpp:398] Iteration: 20 forward-backward time: 10.4855 ms.
I0530 10:00:44.607198  4252 caffe.cpp:398] Iteration: 21 forward-backward time: 10.2709 ms.
I0530 10:00:44.617765  4252 caffe.cpp:398] Iteration: 22 forward-backward time: 10.5503 ms.
I0530 10:00:44.628363  4252 caffe.cpp:398] Iteration: 23 forward-backward time: 10.5811 ms.
I0530 10:00:44.638748  4252 caffe.cpp:398] Iteration: 24 forward-backward time: 10.368 ms.
I0530 10:00:44.649014  4252 caffe.cpp:398] Iteration: 25 forward-backward time: 10.2492 ms.
I0530 10:00:44.660006  4252 caffe.cpp:398] Iteration: 26 forward-backward time: 10.9732 ms.
I0530 10:00:44.670264  4252 caffe.cpp:398] Iteration: 27 forward-backward time: 10.241 ms.
I0530 10:00:44.680344  4252 caffe.cpp:398] Iteration: 28 forward-backward time: 10.064 ms.
I0530 10:00:44.691205  4252 caffe.cpp:398] Iteration: 29 forward-backward time: 10.8438 ms.
I0530 10:00:44.701463  4252 caffe.cpp:398] Iteration: 30 forward-backward time: 10.2411 ms.
I0530 10:00:44.711545  4252 caffe.cpp:398] Iteration: 31 forward-backward time: 10.064 ms.
I0530 10:00:44.722462  4252 caffe.cpp:398] Iteration: 32 forward-backward time: 10.8993 ms.
I0530 10:00:44.732574  4252 caffe.cpp:398] Iteration: 33 forward-backward time: 10.0956 ms.
I0530 10:00:44.742543  4252 caffe.cpp:398] Iteration: 34 forward-backward time: 9.95242 ms.
I0530 10:00:44.753306  4252 caffe.cpp:398] Iteration: 35 forward-backward time: 10.7459 ms.
I0530 10:00:44.763351  4252 caffe.cpp:398] Iteration: 36 forward-backward time: 10.0268 ms.
I0530 10:00:44.773329  4252 caffe.cpp:398] Iteration: 37 forward-backward time: 9.96061 ms.
I0530 10:00:44.783922  4252 caffe.cpp:398] Iteration: 38 forward-backward time: 10.5758 ms.
I0530 10:00:44.793938  4252 caffe.cpp:398] Iteration: 39 forward-backward time: 9.99834 ms.
I0530 10:00:44.803933  4252 caffe.cpp:398] Iteration: 40 forward-backward time: 9.97786 ms.
I0530 10:00:44.814582  4252 caffe.cpp:398] Iteration: 41 forward-backward time: 10.6324 ms.
I0530 10:00:44.824574  4252 caffe.cpp:398] Iteration: 42 forward-backward time: 9.97478 ms.
I0530 10:00:44.834527  4252 caffe.cpp:398] Iteration: 43 forward-backward time: 9.93501 ms.
I0530 10:00:44.845139  4252 caffe.cpp:398] Iteration: 44 forward-backward time: 10.5953 ms.
I0530 10:00:44.855180  4252 caffe.cpp:398] Iteration: 45 forward-backward time: 10.0216 ms.
I0530 10:00:44.865115  4252 caffe.cpp:398] Iteration: 46 forward-backward time: 9.91846 ms.
I0530 10:00:44.875532  4252 caffe.cpp:398] Iteration: 47 forward-backward time: 10.3782 ms.
I0530 10:00:44.885860  4252 caffe.cpp:398] Iteration: 48 forward-backward time: 10.31 ms.
I0530 10:00:44.895802  4252 caffe.cpp:398] Iteration: 49 forward-backward time: 9.92429 ms.
I0530 10:00:44.906133  4252 caffe.cpp:398] Iteration: 50 forward-backward time: 10.3157 ms.
I0530 10:00:44.906145  4252 caffe.cpp:401] Average time per layer: 
I0530 10:00:44.906148  4252 caffe.cpp:404]       data	forward: 0.00152128 ms.
I0530 10:00:44.906153  4252 caffe.cpp:407]       data	backward: 0.0013984 ms.
I0530 10:00:44.906157  4252 caffe.cpp:404]      conv1	forward: 0.568701 ms.
I0530 10:00:44.906159  4252 caffe.cpp:407]      conv1	backward: 0.544353 ms.
I0530 10:00:44.906162  4252 caffe.cpp:404]      relu1	forward: 0.123249 ms.
I0530 10:00:44.906167  4252 caffe.cpp:407]      relu1	backward: 0.00147968 ms.
I0530 10:00:44.906169  4252 caffe.cpp:404]      pool1	forward: 0.108538 ms.
I0530 10:00:44.906174  4252 caffe.cpp:407]      pool1	backward: 0.00133056 ms.
I0530 10:00:44.906180  4252 caffe.cpp:404]      norm1	forward: 0.0466669 ms.
I0530 10:00:44.906183  4252 caffe.cpp:407]      norm1	backward: 0.0870758 ms.
I0530 10:00:44.906189  4252 caffe.cpp:404]      conv2	forward: 0.696534 ms.
I0530 10:00:44.906193  4252 caffe.cpp:407]      conv2	backward: 0.819133 ms.
I0530 10:00:44.906199  4252 caffe.cpp:404]      relu2	forward: 0.0782848 ms.
I0530 10:00:44.906204  4252 caffe.cpp:407]      relu2	backward: 0.00135168 ms.
I0530 10:00:44.906209  4252 caffe.cpp:404]      pool2	forward: 0.0745894 ms.
I0530 10:00:44.906213  4252 caffe.cpp:407]      pool2	backward: 0.00135552 ms.
I0530 10:00:44.906217  4252 caffe.cpp:404]      norm2	forward: 0.0844582 ms.
I0530 10:00:44.906222  4252 caffe.cpp:407]      norm2	backward: 0.157272 ms.
I0530 10:00:44.906227  4252 caffe.cpp:404]      conv3	forward: 0.441866 ms.
I0530 10:00:44.906231  4252 caffe.cpp:407]      conv3	backward: 0.774301 ms.
I0530 10:00:44.906236  4252 caffe.cpp:404]      relu3	forward: 0.0253389 ms.
I0530 10:00:44.906240  4252 caffe.cpp:407]      relu3	backward: 0.00131072 ms.
I0530 10:00:44.906247  4252 caffe.cpp:404]      conv4	forward: 0.333651 ms.
I0530 10:00:44.906252  4252 caffe.cpp:407]      conv4	backward: 0.561223 ms.
I0530 10:00:44.906255  4252 caffe.cpp:404]      relu4	forward: 0.0269018 ms.
I0530 10:00:44.906260  4252 caffe.cpp:407]      relu4	backward: 0.00123712 ms.
I0530 10:00:44.906265  4252 caffe.cpp:404]      conv5	forward: 0.230267 ms.
I0530 10:00:44.906273  4252 caffe.cpp:407]      conv5	backward: 0.336479 ms.
I0530 10:00:44.906277  4252 caffe.cpp:404]      relu5	forward: 0.0163174 ms.
I0530 10:00:44.906282  4252 caffe.cpp:407]      relu5	backward: 0.00121728 ms.
I0530 10:00:44.906287  4252 caffe.cpp:404]      pool5	forward: 0.0202106 ms.
I0530 10:00:44.906291  4252 caffe.cpp:407]      pool5	backward: 0.00125824 ms.
I0530 10:00:44.906296  4252 caffe.cpp:404]        fc6	forward: 0.860172 ms.
I0530 10:00:44.906301  4252 caffe.cpp:407]        fc6	backward: 1.5857 ms.
I0530 10:00:44.906304  4252 caffe.cpp:404]      relu6	forward: 0.00843072 ms.
I0530 10:00:44.906309  4252 caffe.cpp:407]      relu6	backward: 0.00127424 ms.
I0530 10:00:44.906313  4252 caffe.cpp:404]      drop6	forward: 0.0119328 ms.
I0530 10:00:44.906318  4252 caffe.cpp:407]      drop6	backward: 0.0012256 ms.
I0530 10:00:44.906322  4252 caffe.cpp:404]        fc7	forward: 0.364234 ms.
I0530 10:00:44.906327  4252 caffe.cpp:407]        fc7	backward: 0.701275 ms.
I0530 10:00:44.906332  4252 caffe.cpp:404]      relu7	forward: 0.00843584 ms.
I0530 10:00:44.906337  4252 caffe.cpp:407]      relu7	backward: 0.00133568 ms.
I0530 10:00:44.906340  4252 caffe.cpp:404]      drop7	forward: 0.0105677 ms.
I0530 10:00:44.906345  4252 caffe.cpp:407]      drop7	backward: 0.00135744 ms.
I0530 10:00:44.906349  4252 caffe.cpp:404]        fc8	forward: 0.111041 ms.
I0530 10:00:44.906354  4252 caffe.cpp:407]        fc8	backward: 0.18314 ms.
I0530 10:00:44.906358  4252 caffe.cpp:404]       prob	forward: 0.0107859 ms.
I0530 10:00:44.906363  4252 caffe.cpp:407]       prob	backward: 0.00145408 ms.
I0530 10:00:44.906380  4252 caffe.cpp:412] Average Forward pass: 4.46683 ms.
I0530 10:00:44.906386  4252 caffe.cpp:414] Average Backward pass: 6.07781 ms.
I0530 10:00:44.906392  4252 caffe.cpp:416] Average Forward-Backward: 10.5868 ms.
I0530 10:00:44.906397  4252 caffe.cpp:418] Total Time: 529.34 ms.
I0530 10:00:44.906402  4252 caffe.cpp:419] *** Benchmark ends ***