onnx-parser是国内开发者开发的一个ONNX网络模型解析以及推理工具,当前已经被纳入了RT-Thread的开发包,由于RT-Thread的ENV环境支持,下面分析记录一下它的使用和原理分析。
首先下载代码:
git clone https://github.com/wuhanstudio/onnx-parser
下载Scons工具
Scons是一个开放源码、以Python语言编码的自动化构建工具。可以将SCons看作是经典Make实用程序的改进的、跨平台的替代品.
修改编译错误:
代码下载下来,默认是编译不过的,会出现下面的错误:
解决方式是修改其中的 onnx.pb-c.h实现:
diff --git a/onnx.pb-c.h b/onnx.pb-c.h
index 0fe2a2e..22a76f2 100644
--- a/onnx.pb-c.h
+++ b/onnx.pb-c.h
@@ -4,7 +4,7 @@
#ifndef PROTOBUF_C_src_2fonnx_2eproto__INCLUDED
#define PROTOBUF_C_src_2fonnx_2eproto__INCLUDED
-#include <protobuf-c.h>
+#include <protobuf-c/protobuf-c.h>
PROTOBUF_C__BEGIN_DECLS
编译:
进入到example目录下:
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-parser/example$ scons
scons: Reading SConscript files ...
scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o,
but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>
scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o,
but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>
scons: warning: Two different environments were specified for target /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o,
but they appear to have the same action: $CC -o $TARGET -c $CFLAGS $CCFLAGS $_CCCOMCOM $SOURCES
File "/home/caozilong/Workspace/onnx/onnx-parser/example/SConstruct", line 18, in <module>
scons: done reading SConscript files.
scons: Building targets ...
gcc -o backend/add.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/add.c
gcc -o backend/conv2d.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/conv2d.c
gcc -o backend/dense.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/dense.c
gcc -o backend/info.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/info.c
gcc -o backend/matmul.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/matmul.c
gcc -o backend/maxpool.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/maxpool.c
gcc -o backend/model.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/model.c
gcc -o backend/relu.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/relu.c
gcc -o backend/softmax.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/softmax.c
gcc -o backend/transpose.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend backend/transpose.c
gcc -o mnist/mnist.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist.c
gcc -o mnist/mnist_model.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist_model.c
gcc -o mnist/mnist_sm.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend mnist/mnist_sm.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.c
gcc -o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.c
gcc -o onnx-mnist /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o onnx-mnist-model /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist_model.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o onnx-mnist-sm /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o mnist/mnist_sm.o backend/add.o backend/conv2d.o backend/dense.o backend/info.o backend/matmul.o backend/maxpool.o backend/model.o backend/relu.o backend/softmax.o backend/transpose.o -lm
gcc -o parse/parse_test.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend parse/parse_test.c
gcc -o onnx-parser /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o parse/parse_test.o
gcc -o transpose/transpose_test.o -c -I. -I/home/caozilong/Workspace/onnx/onnx-parser -Ibackend transpose/transpose_test.c
gcc -o onnx-transpose /home/caozilong/Workspace/onnx/onnx-parser/onnx-parser.o /home/caozilong/Workspace/onnx/onnx-parser/onnx.pb-c.o /home/caozilong/Workspace/onnx/onnx-parser/protobuf-c.o transpose/transpose_test.o backend/transpose.o backend/info.o -lm
scons: done building targets.
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-parser/example$
验证:
./onnx-parser mnist-sm.onnx
./onnx-mnist
./onnx-mnist-sm
./onnx-mnist-model
backend目录中包含了算子的实现
另外一个算子库:
git clone https://github.com/wuhanstudio/onnx-backend
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-backend$ tree
.
├── examples
│ ├── mnist.c
│ ├── mnist.h
│ ├── mnist_model.c
│ ├── mnist_sm.c
│ └── model
│ ├── mnist-keras.ipynb
│ ├── mnist-lg.onnx
│ └── mnist-sm.onnx
├── README.md
├── SConscript
└── src
├── add.c
├── conv2d.c
├── dense.c
├── info.c
├── matmul.c
├── maxpool.c
├── model.c
├── onnx.h
├── relu.c
├── softmax.c
└── transpose.c
3 directories, 20 files
caozilong@caozilong-Vostro-3268:~/Workspace/onnx/onnx-backend$
网络模型结构:
程序打印出来的网络结构:
规律,输入图像都进行了归一化