香澄派ACT的bug

(base) root@orangepiaipro:/home/HwHiAiUser/samples/ultralytics/examples/YOLOv8-OpenCV-OM-Python# atc --framework=5 --model=yolov8n-cls.onnx --input_format=NCHW --output=yolov8n_1x3x224x224 --log=error --soc_version=Ascend310B4
ATC start working now, please wait for a moment.
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/local/miniconda3/lib/python3.9/threading.py", line 954, in _bootstrap_inner
    self.run()
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/utils/multiprocess_util.py", line 91, in run
    key, func, args, kwargs = self.task_q.get(timeout=TIMEOUT)
  File "<string>", line 2, in get
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 809, in _callmethod
    kind, result = conn.recv()
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 255, in recv
    buf = self._recv_bytes()
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 419, in _recv_bytes
    buf = self._recv(4)
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 384, in _recv
    chunk = read(handle, remaining)
ConnectionResetError: [Errno 104] Connection reset by peer
Traceback (most recent call last):
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 300, in _run_finalizers
    finalizer()
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/util.py", line 224, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
    return func(cls, *args, **kwargs)
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 207, in finalize
    cls.bank_process_pool.close()
AttributeError: 'NoneType' object has no attribute 'close'
...
ATC run failed, Please check the detail log, Try 'atc --help' for more information
E40021: Failed to compile Op [/model.6/m.1/cv2/conv/Conv,[/model.6/m.1/cv2/conv/Conv,/model.6/m.1/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Solution: See the host log for details, and then check the Python stack where the error log is reported.
        TraceBack (most recent call last):
        Compile op[/model.6/m.1/cv2/conv/Conv,[/model.6/m.1/cv2/conv/Conv,/model.6/m.1/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[160]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.8/cv2/conv/Conv,[/model.8/cv2/conv/Conv,/model.8/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.8/cv2/conv/Conv,[/model.8/cv2/conv/Conv,/model.8/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[154]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.9/conv/conv/Conv,[/model.9/conv/conv/Conv,/model.9/conv/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.9/conv/conv/Conv,[/model.9/conv/conv/Conv,/model.9/conv/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[151]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.7/conv/Conv,[/model.7/conv/Conv,/model.7/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.7/conv/Conv,[/model.7/conv/Conv,/model.7/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[157]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.6/cv1/conv/Conv,[/model.6/cv1/conv/Conv,/model.6/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.6/cv1/conv/Conv,[/model.6/cv1/conv/Conv,/model.6/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[172]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.5/conv/Conv,[/model.5/conv/Conv,/model.5/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.5/conv/Conv,[/model.5/conv/Conv,/model.5/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[175]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.8/m.0/cv2/conv/Conv,[/model.8/m.0/cv2/conv/Conv,/model.8/m.0/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.8/m.0/cv2/conv/Conv,[/model.8/m.0/cv2/conv/Conv,/model.8/m.0/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[181]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.6/cv2/conv/Conv,[/model.6/cv2/conv/Conv,/model.6/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.6/cv2/conv/Conv,[/model.6/cv2/conv/Conv,/model.6/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[178]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.8/cv1/conv/Conv,[/model.8/cv1/conv/Conv,/model.8/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.8/cv1/conv/Conv,[/model.8/cv1/conv/Conv,/model.8/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[187]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.4/m.0/cv1/conv/Conv,[/model.4/m.0/cv1/conv/Conv,/model.4/m.0/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.4/m.0/cv1/conv/Conv,[/model.4/m.0/cv1/conv/Conv,/model.4/m.0/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[190]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.2/cv1/conv/Conv,[/model.2/cv1/conv/Conv,/model.2/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.2/cv1/conv/Conv,[/model.2/cv1/conv/Conv,/model.2/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[202]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.2/m.0/cv1/conv/Conv,[/model.2/m.0/cv1/conv/Conv,/model.2/m.0/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.2/m.0/cv1/conv/Conv,[/model.2/m.0/cv1/conv/Conv,/model.2/m.0/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[205]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.4/cv1/conv/Conv,[/model.4/cv1/conv/Conv,/model.4/cv1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.4/cv1/conv/Conv,[/model.4/cv1/conv/Conv,/model.4/cv1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[211]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.2/cv2/conv/Conv,[/model.2/cv2/conv/Conv,/model.2/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.2/cv2/conv/Conv,[/model.2/cv2/conv/Conv,/model.2/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[217]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.1/conv/Conv,[/model.1/conv/Conv,/model.1/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.1/conv/Conv,[/model.1/conv/Conv,/model.1/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[214]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.3/conv/Conv,[/model.3/conv/Conv,/model.3/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.3/conv/Conv,[/model.3/conv/Conv,/model.3/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[220]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.0/conv/Conv,[/model.0/conv/Conv,/model.0/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.0/conv/Conv,[/model.0/conv/Conv,/model.0/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[223]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        Failed to compile Op [/model.4/cv2/conv/Conv,[/model.4/cv2/conv/Conv,/model.4/cv2/conv/Conv]]. (oppath: [Compile /usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py failed with errormsg/stack: File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
    s.connect(address)
ConnectionRefusedError: [Errno 111] Connection refused
], optype: [Conv2D])
        Compile op[/model.4/cv2/conv/Conv,[/model.4/cv2/conv/Conv,/model.4/cv2/conv/Conv]] failed, oppath[/usr/local/Ascend/ascend-toolkit/7.0.0/opp/built-in/op_impl/ai_core/tbe/impl/conv2d.py], optype[Conv2D], taskID[226]. Please check op's compilation error message.[FUNC:ReportBuildErrMessage][FILE:fusion_manager.cc][LINE:771]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.0/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.3/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.2/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.2/m.0/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.2/m.0/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.2/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/m.1/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/m.1/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/m.0/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.4/m.0/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.8/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.8/m.0/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.8/m.0/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.5/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.7/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.9/conv/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.8/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/m.0/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/m.0/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/m.1/cv1/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ProcFailedCompTask] Thread[255084717657376] recompile single op[/model.6/m.1/cv2/conv/Conv] failed[FUNC:ProcessAllFailedCompileTasks][FILE:tbe_op_store_adapter.cc][LINE:954]
        [SubGraphOpt][Compile][ParalCompOp] Thread[255084717657376] process fail task failed[FUNC:ParallelCompileOp][FILE:tbe_op_store_adapter.cc][LINE:1001]
        [SubGraphOpt][Compile][CompOpOnly] CompileOp failed.[FUNC:CompileOpOnly][FILE:op_compiler.cc][LINE:1127]
        [GraphOpt][FusedGraph][RunCompile] Failed to compile graph with compiler Normal mode Op Compiler[FUNC:SubGraphCompile][FILE:fe_graph_optimizer.cc][LINE:1292]
        Call OptimizeFusedGraph failed, ret:-1, engine_name:AIcoreEngine, graph_name:partition0_rank1_new_sub_graph1[FUNC:OptimizeSubGraph][FILE:graph_optimize.cc][LINE:131]
        subgraph 0 optimize failed[FUNC:OptimizeSubGraphWithMultiThreads][FILE:graph_manager.cc][LINE:996]
        build graph failed, graph id:0, ret:-1[FUNC:BuildModelWithGraphId][FILE:ge_generator.cc][LINE:1615]
        GenerateOfflineModel execute failed.
        Compile operator failed, cause: 32Broken pipe   File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/interface.py", line 42, in cann_kb_finalize
    RouteServer.finalize()
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 51, in wrapper
    return func(cls, *args, **kwargs)
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/route.py", line 212, in finalize
    cls.cann_kb_mgr.finalize()
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/knowledge_bank_manager.py", line 41, in finalize
    self.__dynamic_mgr.close()
  File "/usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/common/repository_manager/cann_kb_manager/base_manager.py", line 327, in close
    for name in copy.deepcopy(self.write_kb.keys()):
  File "<string>", line 2, in keys
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/managers.py", line 808, in _callmethod
    conn.send((self._id, methodname, args, kwds))
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 211, in send
    self._send_bytes(_ForkingPickler.dumps(obj))
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 416, in _send_bytes
    self._send(header + buf)
  File "/usr/local/miniconda3/lib/python3.9/multiprocessing/connection.py", line 373, in _send
    n = write(self._handle, buf)