latex画计算机网络图,LaTeX画神经网络图

以下为《LaTeX画神经网络图》的无排版文字预览，完整内容请下载

LaTeX

绘制网络结点图的tikz库

在控制论或者是智能领域，神经网络是经常接触到的，另外，研究网络时，也经常需要绘制网络结点图，下面介绍一个tikz库可以非常方便地绘制这类图。

The following example shows a Rearrangeable Clos Network：

Kalman Filter System Model

/

神经网络绘图包

包的整体设计非常不错，使用也很方便，作者使用该包写了一个版面不错的文档。

Linear regression may be visualised as a graph. The output is simply the weighted sum of?the inputs:

/

Logistic regression is a powerful tool but it can only form simple hypotheses, since it operates?on a linear combination of the input values (albeit applying a non-linear function as soon as?possible). Neural networks are constructed from layers of such non-linear mixing elements,?allowing development of more complex hypotheses. This is achieved by stacking4 logistic?regression networks to produce more complex behaviour. The inclusion of extra non-linear?mixing stages between the input and the output nodes can increase the complexity of the?network, allowing it to develop more advanced hypotheses. This is relatively simple:

/

The presence of multiple layers can be used to construct all the elementary logic gates. This?in turn allows construction of advanced digital processing logic in neural networks and?this construction occurs automatically during the learning stage. Some examples are shown?below, which take inputs of 0/1 and which return a positive output for true and a non-positive?output for false:

/

From these, it becomes trivial to construct other gates. Negating the ?values produces?the inverted gates, and these can be used to construct more complex gates. Thus, neural?networks may be understood as “self-designing microchips”, capable of both digital and?analogue processing：

Omnigraffle

OmniGraffle是由The Omni Group制作的一款绘图软件，其只能于运行在Mac OS X和iPad平台之上，添加公式可以配合latexit使用。可以用来绘制图表，流程图，组织结构图以及插图，也可以用来组织头脑中思考的信息，组织头脑风暴的结果，绘制心智图，作为样式管理器，或设计网页或PDF文档的原型。嵌入在论文里导出成pdf，嵌入在网页里导出成svg。十分方便。

///

Python

draw_convnet

Python script for illustrating Convolutional Neural Network (ConvNet)：

/

部分代码：

/

DSL

DSL 深度神经网络，支持 Torch 和 Caffe

DNNGraph - A deep neural network model generation DSL in Haskell

It consists of several parts:

A DSL for specifying the model. This uses the?lens?library for elegant, composable constructions, and the?fgl?graph library for specifying the network layout.

A set of optimization passes that run over the graph representation to improve the performance of the model. For example, we can take advantage of the fact that several layers types (ReLU,?Dropout) can operate in-place.

A set of backends to generate code for the platform. Currently, we generate

Caffe (by generating model?prototxt?files)

Torch (by generating Lua scripts)

A set of useful CLI tools for exporting, visualizing and understanding a model (visualization of network structure, parameter density)

DSL Examples：

//

(部分)

Joseph Paul Cohen Ph.D

* Postdoctoral Fellow at Montreal Institute for Learning Algorithms at University of Montreal

* Friend of the Farlow Fellow at Harvard University

* National Science Foundation Graduate Fellow

Visualizing CNN architectures side by side with mxnet

Convolutional Neural Networks can be visualized as computation graphs with input nodes where the computation starts and output nodes where the result can be read. Here the models that are provided with mxnet are compared using the?mx.viz.plot_network?method. The output node is at the top and the input node is at the bottom.

/

/

(部分)

Python + Graphviz

针对节点较多的网络，不可避免需要投入大量时间来写重复的脚本代码。用python编写了一个简单的dot脚本生成工具(MakeNN)，可以很方便的输入参数生成nn结构图。

部分代码：/

/

Graphviz -?dot

在dot里面label的玩法比较多，在上面看到的每个节点都是简单的一段文字，如果想要比较复杂的结构怎么办？如下图：

/

对应的代码如下：

/

这个还不算厉害的，label还支持HTML格式的，这样你能想得到的大部分样子的节点都可以被定义出来了：

/

对应的代码如下：

/

接着来看cluster的概念，在dot中以cluster开头的子图会被当做是一个新的布局来处理，而不是在原图的基础上继续操作。比如：

/

对应的代码如下：

/

如果没有cluster的话我们大概能想象的出来最后的结果是什么样子的。可能会想能不能将一个节点直接指向cluster？答案是不能！对于这种需求可以用lhead来搞定：

/

生成图片如下：

/

Keras

使用Keras框架(后端可选tensorflow或者theano)，可以画出卷积神经网络的结构图。

from keras.layers import Input, Convolution2D, Flatten, Dense, Activationfrom keras.models import Sequentialfrom keras.optimizers import SGD , Adamfrom keras.initializations import normalfrom keras.utils.visualize_util import plot# apply a 3x3 convolution with 64 output filters on a 256x256 image:model = Sequential()

model.add(Convolution2D(64, 3, 3, border_mode='same', dim_ordering='th',input_shape=(3, 256, 256)))# now model.output_shape == (None, 64, 256, 256)# add a 3x3 convolution on top, with 32 output filters:model.add(Convolution2D(32, 3, 3, border_mode='same', dim_ordering='th'))# now model.output_shape == (None, 32, 256, 256)adam = Adam(lr=1e-6)

model.compile(loss='mse',optimizer=adam)

print("We finish building the model")

plot(model, to_file='model1.png', show_shapes=True)

/

from keras.layers import Input, Convolution2D, MaxPooling2D, Flatten, Dense

from keras.models import Model

from keras.utils.visualize_util import plotinputs = Input(shape=(2)

/

from keras.layers import Input, Convolution2D, Flatten, Dense, Activationfrom keras.models import Sequentialfrom keras.optimizers import SGD , Adamfrom keras.initializations import normalfrom keras.utils.visualize_util import plot

print("Now we build the model")

model = Sequential()

img_channels = 4 #output dimenson nothing with channelsimg_rows = 80img_cols = 80model.add(Convolution2D(32, 8, 8, subsample=(4,4),init=lambda shape, name: normal(shape, scale=0.01, name=name), border_mode='same', dim_ordering='th',input_shape=(img_channels,img_rows,img_cols)))

model.add(Activation('relu'))

model.add(Convolution2D(64, 4, 4, subsample=(2,2),init=lambda shape, name: normal(shape, scale=0.01, name=name), border_mode='same', dim_ordering='th'))

model.add(Activation('relu'))

model.add(Convolution2D(64, 3, 3, subsample=(1,1),init=lambda shape, name: normal(shape, scale=0.01, name=name), border_mode='same', dim_ordering='th'))

model.add(Activation('relu'))

model.add(Flatten())

model.add(Dense(512, init=lambda shape, name: normal(shape, scale=0.01, name=name)))

model.add(Activation('relu'))

model.add(Dense(2,init=lambda shape, name: normal(shape, scale=0.01, name=name)))

adam = Adam(lr=1e-6)

model.compile(loss='mse',optimizer=adam)

print("We finish building the model")

plot(model, to_file='model3.png', show_shapes=True)

/

Netscope

Netscope是个支持prototxt格式描述的神经网络结构的在线可视工具，地址：

http://ethereon.github.io/netscope/quickstart.html?

/

它可以用来可视化Caffe结构里prototxt格式的网络结构。地址：

http://ethereon.github.io/netscope/#/editor

/

点击Launch Editor，把你描述神经网络结构的prototxt文件复制到该编辑框里，按shift＋enter，就可以直接以图形方式显示网络的结构。?

比如,以mnist的LeNet网络结构为例，把Caffe中example/mnist/lenet_train_test.prototxt文件的内容复制到编译框，按shift + enter,立即就可以得到可视化的结构图。?

/

Keras

Python/draw_net.py, 这个文件，就是用来绘制网络模型的。也就是将网络模型由prototxt变成一张图片。

绘制Lenet模型

# sudo python python/draw_net.py examples/mnist/lenet_train_test.prototxt netImage/lenet.png --rankdir=TB

/

(部分)

Keras

//

以上为《LaTeX画神经网络图》的无排版文字预览，完整内容请下载