mnist data reading 代码分析

最新推荐文章于 2020-12-15 20:05:49 发布

伍子胥

最新推荐文章于 2020-12-15 20:05:49 发布

阅读量481

点赞数

分类专栏： coding 文章标签： mnist data reading 解读分析

本文链接：https://blog.csdn.net/songkun123/article/details/90742245

版权

本文详细分析了MNIST数据的读取过程，重点关注numpy.dtype.newbyteorder方法，它用于更改数据类型的字节顺序，并影响所有字段和子数组。同时，解释了numpy.frombuffer在缓冲区作为1维数组解释时的作用。此外，文章还探讨了dense_to_one_hot转换以及@property装饰器的使用。

摘要由CSDN通过智能技术生成

def _read32(bytestream):
  dt = numpy.dtype(numpy.uint32).newbyteorder('>')
  return numpy.frombuffer(bytestream.read(4), dtype=dt)[0]

分析：

numpy.dtype.newbyteorder

method

dtype.newbyteorder(new_order='S')

Return a new dtype with a different byte order.

Changes are also made in all fields and sub-arrays of the data type.

Parameters:	new_order : string, optional Byte order to force; a value from the byte order specifications below. The default value (‘S’) results in swapping the current byte order. new_order codes can be any of: ‘S’ - swap dtype from current to opposite endian {‘<’, ‘L’} - little endian {‘>’, ‘B’} - big endian {‘=’, ‘N’} - native order {‘\|’, ‘I’} - ignore (no change to byte order) The code does a case-insensitive check on the first letter of new_order for these alternatives. For example, any of ‘>’ or ‘B’ or ‘b’ or ‘brian’ are valid to specify big-endian.
Returns:	new_dtype : dtype New dtype object with the given change to the byte order.

Parameters:

new_order : string, optional

Byte order to force; a value from the byte order specifications below. The default value (‘S’) results in swapping the current byte order. new_order codes can be any of:

‘S’ - swap dtype from current to opposite endian
{‘<’, ‘L’} - little endian
{‘>’, ‘B’} - big endian
{‘=’, ‘N’} - native order
{‘|’, ‘I’} - ignore (no change to byte order)

The code does a case-insensitive check on the first letter of new_order for these alternatives. For example, any of ‘>’ or ‘B’ or ‘b’ or ‘brian’ are valid to specify big-endian.

Returns:

new_dtype : dtype

New dtype object with the given change to the byte order.

Changes are also made in all fields and sub-arrays of the data type.

Examples

>>>

>>> import sys
>>> sys_is_le = sys.byteorder == 'little'
>>> native_code = sys_is_le and '<' or '>'
>>> swapped_code = sys_is_le and '>' or '<'
>>> native_dt = np.dtype(native_code+'i2')
>>> swapped_dt = np.dtype(swapped_code+'i2')
>>> native_dt.newbyteorder('S') == swapped_dt
True
>>> native_dt.newbyteorder() == swapped_dt
True
>>> native_dt == swapped_dt.newbyteorder('S')
True
>>> native_dt == swapped_dt.newbyteorder('=')
True
>>> native_dt == swapped_dt.newbyteorder('N')
True
>