TFLite: 模型文件的结构和解析器

最新推荐文章于 2024-08-13 18:03:26 发布

shuai_wen

最新推荐文章于 2024-08-13 18:03:26 发布

阅读量7.8k

点赞数 3

分类专栏：人工智能

本文链接：https://blog.csdn.net/u011279649/article/details/83186550

版权

人工智能专栏收录该内容

159 篇文章 14 订阅

订阅专栏

TFLite Model file

Model

table Model {
// Version of the schema.
version:uint;

// A list of all operator codes used in this model. This is
// kept in order because operators carry an index into this
// vector.
operator_codes:[OperatorCode];

// All the subgraphs of the model. The 0th is assumed to be the main
// model.
subgraphs:[SubGraph];

// A description of the model.
description:string;

// Buffers of the model.
// NOTE: It is required that the first entry in here is always an empty
// buffer. This is so that the default buffer index of zero in Tensor
// will always refer to a valid empty buffer.
buffers:[Buffer];

}

OperatorCode

// An OperatorCode can be an enum value (BuiltinOperator) if the operator is a
// builtin, or a string if the operator is custom.
table OperatorCode {
builtin_code:BuiltinOperator;
custom_code:string;
}
// A list of builtin operators. Builtin operators are slightly faster than custom
// ones, but not by much. Moreover, while custom operators accept an opaque
// object containing configuration parameters, builtins have a predetermined
// set of acceptable options.
enum BuiltinOperator : byte {
ADD = 0,
AVERAGE_POOL_2D = 1,
CONCATENATION = 2,
CONV_2D = 3,
DEPTHWISE_CONV_2D = 4,
// DEPTH_TO_SPACE = 5,
// DEQUANTIZE = 6,
EMBEDDING_LOOKUP = 7,

}

其中的Op Code(每个op code的Indice),注意这个和Op(具体的运算:input/output tensor,具体的操作)区别开

TFLite模型文件格式：主结构体是Modle，其中的operator_codes定义了该模型用到的算子Op Code;

subgraphs定义了Model中的子图，其中第一个子图是主图；

buffers:是数据存储区域，主要保存是模型的权重

SubGraph

Model中最主要的结构体，定义了图的具体结构

// The root type, defining a model.
table SubGraph {
// A list of all tensors used in this model.//all tensors中又分为inputs/output?
tensors:[Tensor];

// Indices of the input tensors.
inputs:[int];

// Indices of the output tensors.
outputs:[int];

// All operators, in execution order.
operators:[Operator];

// Name of subgraph (used for debugging).
name:string;
}

tensors:定义了子图中的所有tensor

inputs/outputs通过索引的形式定义了整个图的输入、输出tensor

operators定义了子图中的各个算子

Tensor

table Tensor {
// The tensor shape. The meaning of each entry is operator-specific but
// builtin ops use: [batch size, number of channels, height, width] (That's
// Tensorflow's NCHW).
shape:[int];
type:TensorType;
// An index that refers to the buffers table at the root of the model. Or,
// if there is no data buffer associated (i.e. intermediate results), then
// this is 0 (which refers to an always existent empty buffer).
//
// The data_buffer itself is an opaque container, with the assumption that the
// target device is little-endian. In addition, all builtin operators assume
// the memory is ordered such that if `shape` is [4, 3, 2], then index
// [i, j, k] maps to data_buffer[i*3*2 + j*3 + k].
buffer:uint;
name:string; // For debugging and importing back into tensorflow.
quantization:QuantizationParameters; // Optional.
}

Tensor定义了形状、类型和对应的buffer索引值

Operator

// An operator takes tensors as inputs and outputs. The type of operation being
// performed is determined by an index into the list of valid OperatorCodes,
// while the specifics of each operations is configured using builtin_options
// or custom_options.
table Operator {
// Index into the operator_codes array. Using an integer here avoids
// complicate map lookups.
opcode_index:uint;

inputs:[int];
outputs:[int];

builtin_options:BuiltinOptions;
custom_options:[ubyte];
}

operator是subGraph中的最重要结构体，定义了图的形状

opcode_index定义了算子的索引

inputs/outputs定义了operator输入、输出的tensor的索引值.