CIFAR10 代码分析详解——cifar10.py

最新推荐文章于 2024-08-01 14:05:32 发布

TomoBladeLee

最新推荐文章于 2024-08-01 14:05:32 发布

阅读量1.3w

点赞数 5

文章标签：机器学习

本文链接：https://blog.csdn.net/qq_19918373/article/details/67649638

版权

本文详细分析了CIFAR10数据集的代码实现，包括变量生成函数，如何处理weight decay，以及训练模型的具体步骤。在测试阶段，使用cifar10_input.inputs获取未扭曲的图像。同时，文章介绍了如何记录变量和梯度，并应用滑动平均来优化模型。

摘要由CSDN通过智能技术生成

引入库，定义各种参数

from __future__ import absolute_import
from __future__ import division
from __future__ import print_function

import os
import re
import sys
import tarfile

from six.moves import urllib
import tensorflow as tf

import cifar10_input

FLAGS = tf.app.flags.FLAGS

# Basic model parameters.
tf.app.flags.DEFINE_integer('batch_size', 128,
                            """Number of images to process in a batch.""")
tf.app.flags.DEFINE_string('data_dir', '/tmp/cifar10_data',
                           """Path to the CIFAR-10 data directory.""")
tf.app.flags.DEFINE_boolean('use_fp16', False,
                            """Train the model using fp16.""")

# Global constants describing the CIFAR-10 data set.
IMAGE_SIZE = cifar10_input.IMAGE_SIZE
NUM_CLASSES = cifar10_input.NUM_CLASSES
NUM_EXAMPLES_PER_EPOCH_FOR_TRAIN = cifar10_input.NUM_EXAMPLES_PER_EPOCH_FOR_TRAIN
NUM_EXAMPLES_PER_EPOCH_FOR_EVAL = cifar10_input.NUM_EXAMPLES_PER_EPOCH_FOR_EVAL


# Constants describing the training process.
MOVING_AVERAGE_DECAY = 0.9999     # The decay to use for the moving average.
NUM_EPOCHS_PER_DECAY = 350.0      # Epochs after which learning rate decays.
LEARNING_RATE_DECAY_FACTOR = 0.1  # Learning rate decay factor.
INITIAL_LEARNING_RATE = 0.1       # Initial learning rate.

# If a model is trained with multiple GPUs, prefix all Op names with tower_name
# to differentiate the operations. Note that this prefix is removed from the
# names of the summaries when visualizing a model.
TOWER_NAME = 'tower'

DATA_URL = 'http://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz'

创建一个 summary 函数来记录 histogram 和 scalar，注意 scalar 记录的是x中0占的比例，用以衡量x的稀疏性sparsity。

def _activation_summary(x):
  """Helper to create summaries for activations.
  Creates a summary that provides a histogram of activations.
  Creates a summary that measures the sparsity of activations.
  Args:
    x: Tensor
  Returns:
    nothing
  """
  # Remove 'tower_[0-9]/' from the name in case this is a multi-GPU training
  # session. This helps the clarity of presentation on tensorboard.
  tensor_name = re.sub('%s_[0-9]*/' % TOWER_NAME, '', x.op.name)
  tf.summary.histogram(tensor_name + '/activations', x)
  tf.summary.scalar(tensor_name + '/sparsity',
                                       tf.nn.zero_fraction(x))

创建 variable 生成函数，该变量存储在 cpu:0 上。输入参数 initializer 是用来指定何种方式初始化变量，比如：initializer=tf.constant_initializer(0.0)/tf.truncated_normal_initializer(stddev