IBM云平台linux下训练yolov3，GPU被其他程序占用，内存不够导致报错

超参重新调整后，开始运行程序训练yolov3，开始以为是调整程序，修改参数导致的错误。但在恢复原参数，还是照样错误，通过对错误代码的解读，是GPU内存不够导致。但比较奇怪的是对于IBM云平台，只能训练被指定分配的GPU，被其他人的程序占用，导致报错。

2019-09-07 17:10:57.137765: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fa605800 of size 2048
2019-09-07 17:10:57.137771: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fa606000 of size 2048
2019-09-07 17:10:57.137777: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fa606800 of size 2048
2019-09-07 17:10:57.137783: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fa607000 of size 2048
2019-09-07 17:10:57.137789: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fa607800 of size 4718592
2019-09-07 17:10:57.137795: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faa87800 of size 4718592
2019-09-07 17:10:57.137801: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faf07800 of size 256
2019-09-07 17:10:57.137807: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faf07900 of size 4096
2019-09-07 17:10:57.137813: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faf08900 of size 4096
2019-09-07 17:10:57.137819: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faf09900 of size 4096
2019-09-07 17:10:57.137824: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84faf0a900 of size 18874368
2019-09-07 17:10:57.137831: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc10a900 of size 2048
2019-09-07 17:10:57.137837: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc10b100 of size 2048
2019-09-07 17:10:57.137843: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc10b900 of size 2048
2019-09-07 17:10:57.137849: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc10c100 of size 2048
2019-09-07 17:10:57.137854: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc10c900 of size 2097152
2019-09-07 17:10:57.137860: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc30c900 of size 4096
2019-09-07 17:10:57.137868: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc30d900 of size 4096
2019-09-07 17:10:57.137874: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc30e900 of size 4096
2019-09-07 17:10:57.137882: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc30f900 of size 4096
2019-09-07 17:10:57.137888: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fc310900 of size 18874368
2019-09-07 17:10:57.137894: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd510900 of size 2048
2019-09-07 17:10:57.137900: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd511100 of size 2048
2019-09-07 17:10:57.137906: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd511900 of size 2048
2019-09-07 17:10:57.137912: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd512100 of size 2048
2019-09-07 17:10:57.137918: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd512900 of size 2097152
2019-09-07 17:10:57.137924: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd712900 of size 4096
2019-09-07 17:10:57.137930: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd713900 of size 4096
2019-09-07 17:10:57.137936: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd714900 of size 4096
2019-09-07 17:10:57.137942: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd715900 of size 4096
2019-09-07 17:10:57.137948: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fd716900 of size 18874368
2019-09-07 17:10:57.137954: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fe916900 of size 2048
2019-09-07 17:10:57.137960: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fe917100 of size 2048
2019-09-07 17:10:57.137965: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fe917900 of size 2048
2019-09-07 17:10:57.137971: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fe918100 of size 2048
2019-09-07 17:10:57.137977: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fe918900 of size 2097152
2019-09-07 17:10:57.137983: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84feb18900 of size 4096
2019-09-07 17:10:57.137989: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84feb19900 of size 4096
2019-09-07 17:10:57.137994: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84feb1a900 of size 4096
2019-09-07 17:10:57.138000: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84feb1b900 of size 4096
2019-09-07 17:10:57.138006: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84feb1c900 of size 18874368
2019-09-07 17:10:57.138012: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd1c900 of size 256
2019-09-07 17:10:57.138018: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd1ca00 of size 256
2019-09-07 17:10:57.138024: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd1cb00 of size 256
2019-09-07 17:10:57.138030: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd1cc00 of size 256
2019-09-07 17:10:57.138036: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd1cd00 of size 32768
2019-09-07 17:10:57.138042: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd24d00 of size 2048
2019-09-07 17:10:57.138048: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd25500 of size 2048
2019-09-07 17:10:57.138054: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd25d00 of size 2048
2019-09-07 17:10:57.138060: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd26500 of size 2048
2019-09-07 17:10:57.138065: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84ffd26d00 of size 2097152
2019-09-07 17:10:57.138071: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fff26d00 of size 4096
2019-09-07 17:10:57.138077: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fff27d00 of size 4096
2019-09-07 17:10:57.138083: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fff28d00 of size 4096
2019-09-07 17:10:57.138088: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fff29d00 of size 4096
2019-09-07 17:10:57.138095: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f84fff2ad00 of size 18874368
2019-09-07 17:10:57.138101: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850112ad00 of size 512
2019-09-07 17:10:57.138107: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850112af00 of size 512
2019-09-07 17:10:57.138112: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850112b100 of size 512
2019-09-07 17:10:57.138119: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850112b300 of size 512
2019-09-07 17:10:57.138125: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850112b500 of size 294912
2019-09-07 17:10:57.138130: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8501173500 of size 256
2019-09-07 17:10:57.138136: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8501173600 of size 256
2019-09-07 17:10:57.138310: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8501173700 of size 256
2019-09-07 17:10:57.138316: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8501173800 of size 256
2019-09-07 17:10:57.138322: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8501173900 of size 32768
2019-09-07 17:10:57.138328: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850117b900 of size 512
2019-09-07 17:10:57.138334: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850117bb00 of size 512
2019-09-07 17:10:57.138340: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850117bd00 of size 512
2019-09-07 17:10:57.138346: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850117bf00 of size 512
2019-09-07 17:10:57.138352: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850117c100 of size 294912
2019-09-07 17:10:57.138358: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85011c4100 of size 1024
2019-09-07 17:10:57.138364: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85011c4500 of size 1024
2019-09-07 17:10:57.138370: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85011c4900 of size 1024
2019-09-07 17:10:57.138376: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85011c4d00 of size 1024
2019-09-07 17:10:57.138382: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85011c5100 of size 1179648
2019-09-07 17:10:57.138388: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e5100 of size 2048
2019-09-07 17:10:57.138394: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e5900 of size 2048
2019-09-07 17:10:57.138400: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e6100 of size 2048
2019-09-07 17:10:57.138406: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e6900 of size 2048
2019-09-07 17:10:57.138411: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e7100 of size 2048
2019-09-07 17:10:57.138417: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e7900 of size 2048
2019-09-07 17:10:57.138425: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85012e8100 of size 2097152
2019-09-07 17:10:57.138432: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85014e8100 of size 2097152
2019-09-07 17:10:57.138439: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016e8100 of size 4096
2019-09-07 17:10:57.138445: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016e9100 of size 4096
2019-09-07 17:10:57.138451: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016ea100 of size 4096
2019-09-07 17:10:57.138457: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016eb100 of size 4096
2019-09-07 17:10:57.138463: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016ec100 of size 4096
2019-09-07 17:10:57.138469: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016ed100 of size 4096
2019-09-07 17:10:57.138475: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85016ee100 of size 18874368
2019-09-07 17:10:57.138481: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85028ee100 of size 18874368
2019-09-07 17:10:57.138491: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aee100 of size 1024
2019-09-07 17:10:57.138497: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aee500 of size 1024
2019-09-07 17:10:57.138503: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aee900 of size 1024
2019-09-07 17:10:57.138509: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aeed00 of size 1024
2019-09-07 17:10:57.138515: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aef100 of size 1024
2019-09-07 17:10:57.138521: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aef500 of size 1024
2019-09-07 17:10:57.138527: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503aef900 of size 524288
2019-09-07 17:10:57.138533: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503b6f900 of size 524288
2019-09-07 17:10:57.138539: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bef900 of size 2048
2019-09-07 17:10:57.138545: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf0100 of size 2048
2019-09-07 17:10:57.138551: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf0900 of size 2048
2019-09-07 17:10:57.138557: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf1100 of size 2048
2019-09-07 17:10:57.138563: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf1900 of size 2048
2019-09-07 17:10:57.138569: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf2100 of size 2048
2019-09-07 17:10:57.138575: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8503bf2900 of size 4718592
2019-09-07 17:10:57.138581: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504072900 of size 4718592
2019-09-07 17:10:57.138586: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f2900 of size 1024
2019-09-07 17:10:57.138592: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f2d00 of size 1024
2019-09-07 17:10:57.138598: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f3100 of size 1024
2019-09-07 17:10:57.138604: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f3500 of size 1024
2019-09-07 17:10:57.138610: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f3900 of size 1024
2019-09-07 17:10:57.138616: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f3d00 of size 1024
2019-09-07 17:10:57.138622: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85044f4100 of size 524288
2019-09-07 17:10:57.138627: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504574100 of size 524288
2019-09-07 17:10:57.138633: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f4100 of size 2048
2019-09-07 17:10:57.138639: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f4900 of size 2048
2019-09-07 17:10:57.138645: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f5100 of size 2048
2019-09-07 17:10:57.138651: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f5900 of size 2048
2019-09-07 17:10:57.138657: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f6100 of size 2048
2019-09-07 17:10:57.138663: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f6900 of size 2048
2019-09-07 17:10:57.138669: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85045f7100 of size 4718592
2019-09-07 17:10:57.138675: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504a77100 of size 4718592
2019-09-07 17:10:57.138681: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504ef7100 of size 256
2019-09-07 17:10:57.138687: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504ef7200 of size 256
2019-09-07 17:10:57.138693: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504ef7300 of size 98304
2019-09-07 17:10:57.138699: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f0f300 of size 98304
2019-09-07 17:10:57.138705: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27300 of size 512
2019-09-07 17:10:57.138710: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27500 of size 512
2019-09-07 17:10:57.138716: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27700 of size 512
2019-09-07 17:10:57.138896: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27900 of size 512
2019-09-07 17:10:57.138902: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27b00 of size 512
2019-09-07 17:10:57.138908: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27d00 of size 512
2019-09-07 17:10:57.138914: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f27f00 of size 131072
2019-09-07 17:10:57.138921: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f47f00 of size 131072
2019-09-07 17:10:57.138926: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f67f00 of size 512
2019-09-07 17:10:57.138932: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68100 of size 512
2019-09-07 17:10:57.138938: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68300 of size 512
2019-09-07 17:10:57.138944: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68500 of size 512
2019-09-07 17:10:57.138950: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68700 of size 512
2019-09-07 17:10:57.138956: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68900 of size 512
2019-09-07 17:10:57.138962: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68b00 of size 256
2019-09-07 17:10:57.138968: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68c00 of size 256
2019-09-07 17:10:57.138974: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68d00 of size 256
2019-09-07 17:10:57.138980: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68e00 of size 256
2019-09-07 17:10:57.138986: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f68f00 of size 3584
2019-09-07 17:10:57.138992: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f69d00 of size 256
2019-09-07 17:10:57.138998: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f69e00 of size 256
2019-09-07 17:10:57.139006: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f69f00 of size 256
2019-09-07 17:10:57.139012: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f6a000 of size 256
2019-09-07 17:10:57.139020: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f6a100 of size 73728
2019-09-07 17:10:57.139026: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f7c100 of size 512
2019-09-07 17:10:57.139032: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f7c300 of size 512
2019-09-07 17:10:57.139038: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f7c500 of size 512
2019-09-07 17:10:57.139045: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f7c700 of size 512
2019-09-07 17:10:57.139050: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f7c900 of size 131072
2019-09-07 17:10:57.139057: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f9c900 of size 1024
2019-09-07 17:10:57.139062: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f9cd00 of size 1024
2019-09-07 17:10:57.139068: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f9d100 of size 1024
2019-09-07 17:10:57.139074: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f9d500 of size 1024
2019-09-07 17:10:57.139080: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8504f9d900 of size 1179648
2019-09-07 17:10:57.139086: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050bd900 of size 512
2019-09-07 17:10:57.139092: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050bdb00 of size 512
2019-09-07 17:10:57.139098: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050bdd00 of size 512
2019-09-07 17:10:57.139104: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050bdf00 of size 512
2019-09-07 17:10:57.139109: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050be100 of size 131072
2019-09-07 17:10:57.139116: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050de100 of size 1024
2019-09-07 17:10:57.139121: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050de500 of size 1024
2019-09-07 17:10:57.139127: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050de900 of size 1024
2019-09-07 17:10:57.139133: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050ded00 of size 1024
2019-09-07 17:10:57.139138: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85050df100 of size 1179648
2019-09-07 17:10:57.139144: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85051ff100 of size 512
2019-09-07 17:10:57.139150: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85051ff300 of size 512
2019-09-07 17:10:57.139156: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85051ff500 of size 512
2019-09-07 17:10:57.139162: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85051ff700 of size 512
2019-09-07 17:10:57.139168: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85051ff900 of size 131072
2019-09-07 17:10:57.139173: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850521f900 of size 1024
2019-09-07 17:10:57.139179: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f850521fd00 of size 1024
2019-09-07 17:10:57.139185: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505220100 of size 1024
2019-09-07 17:10:57.139191: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505220500 of size 1024
2019-09-07 17:10:57.139197: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505220900 of size 1179648
2019-09-07 17:10:57.139203: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505340900 of size 512
2019-09-07 17:10:57.139209: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505340b00 of size 512
2019-09-07 17:10:57.139215: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505340d00 of size 512
2019-09-07 17:10:57.139221: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505340f00 of size 512
2019-09-07 17:10:57.139226: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505341100 of size 131072
2019-09-07 17:10:57.139232: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505361100 of size 1024
2019-09-07 17:10:57.139238: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505361500 of size 1024
2019-09-07 17:10:57.139244: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505361900 of size 1024
2019-09-07 17:10:57.139250: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505361d00 of size 1024
2019-09-07 17:10:57.139256: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505362100 of size 1179648
2019-09-07 17:10:57.139262: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505482100 of size 512
2019-09-07 17:10:57.139268: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505482300 of size 512
2019-09-07 17:10:57.139273: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505482500 of size 512
2019-09-07 17:10:57.139279: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505482700 of size 512
2019-09-07 17:10:57.139285: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f8505482900 of size 131072
2019-09-07 17:10:57.139291: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85054a2900 of size 1024
2019-09-07 17:10:57.139297: I tensorflow/core/common_runtime/bfc_allocator.cc:665] Chunk at 0x7f85054a2d00 of size 1024
2019-09-07 17:10:57.139481: I tensorflow/cor