训练报错
python: /opt/conda/conda-bld/magma-cuda101_1572909250636/work/interface_cuda/interface.cpp:808: void magma_queue_create_internal(magma_device_t, magma_queue**, const char*, const char*, int): Assertion `queue->dBarray__ != __null’ failed.
Aborted (core dumped)
I ran my code on GTX 1080. The GPU memory usage is 0 to 200 MB when nothing’s running. However, after this error happened, the GPU memory usage went up to 700MB, and I have to restart the machine to free the memory, otherwise cuda will go out of memory when I run the same code again. I think there’s memory leak in this bug.
https://github.com/pytorch/pytorch/issues/26120
Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
解决:
conda install mkl==11.3.3
https://www.jianshu.com/p/4a74e6bee332