/// Storage manager across multiple devices
struct Handle
void* dptr; /// Pointer to the data.
size_t size; /// Size of the storage.
Context ctx; /// Context information about device and ID.
/// Base storage manager interface
class StorageManager
Alloc()
Free()
class NaiveStorageManager, PooledStorageManager
class CPUDeviceStorage, GPUDeviceStorage, PinnedMemoryStorage
class LazyAllocArray: Get element of corresponding index, if it is not created create by creator
class MXNET_API Storage
1 mxnet存储管理器
2 存储由内存地址,大小,设备属性构成,分别对应Handle: dptr, size, ctx
3 存储管理器主要负责内存申请,内存销毁操作
4 实现内存复用,节省内存new/delete引起的开销,主要由PooledStorageManager类完成
5 存储设备包括GPU, CPU, PinnedCPU, 具体实现分别由GPUDeviceStorage, CPUDeviceStorage与PinnedMemoryStorage实现
struct Handle
void* dptr; /// Pointer to the data.
size_t size; /// Size of the storage.
Context ctx; /// Context information about device and ID.
/// Base storage manager interface
class StorageManager
Alloc()
Free()
class NaiveStorageManager, PooledStorageManager
class CPUDeviceStorage, GPUDeviceStorage, PinnedMemoryStorage
class LazyAllocArray: Get element of corresponding index, if it is not created create by creator
class MXNET_API Storage
1 mxnet存储管理器
2 存储由内存地址,大小,设备属性构成,分别对应Handle: dptr, size, ctx
3 存储管理器主要负责内存申请,内存销毁操作
4 实现内存复用,节省内存new/delete引起的开销,主要由PooledStorageManager类完成
5 存储设备包括GPU, CPU, PinnedCPU, 具体实现分别由GPUDeviceStorage, CPUDeviceStorage与PinnedMemoryStorage实现
6 优点:封装内存管理类,尤其是pooled管理策略!结合其LazyAllocArray功能,可以实现内存复用,减少内存new/delete 操作