python-tensorflow：tensorboard神经网络可视化

tensorboard对神经网络可视化

tensorflow中采优化学习采用backprogram算法进行权值weight和偏差biases调节。
backprogram算法核心思想：后向传播能够知道如何更改网络中的权重和偏差来改变代价函数值。

基于之前对y=x^2+0.5拟合代码修改完善，从而可以采用tensorboard对神经网络可视化，更好理解backprogram算法的过程。

修改代码如下：

import tensorflow as tf
import numpy as np
import matplotlib.pyplot as plt

def add_layer(inputs, in_size, out_size, activation_function=None):

    with tf.name_scope('layer'):
        with tf.name_scope('weights'):
            weights = tf.Variable(tf.random.normal([in_size, out_size]),name='W')
        with tf.name_scope('biases'):
            biases = tf.Variable(tf.zeros([1,out_size])+0.1, name='b')
        with tf.name_scope('Wx_plus_b'):
            Wx_plus_b = tf.add(tf.matmul(inputs,weights), biases)
        if activation_function is None:
            return Wx_plus_b
        else: