ValueError: Compile error, args: {"composite":true,"composite_graph":"31.31","id":0,"input_desc":null,"op":"Fused_BroadcastTo_inplace_assign_builder_5556381674713328303","op_desc":[{"attr":[{"data_type":"listInt","name":"shape","value":[120]}],"impl_path":"","input_desc":[[{"data_type":"float32","format":"DefaultFormat","name":"input_0","shape":[1],"tensor_name":"input_0","value":0.0}]],"name":"BroadcastTo","output_desc":[{"data_type":"float32","format":"DefaultFormat","name":"output_0","shape":[120],"tensor_name":"output_0_0"}]}],"output_desc":[{"data_type":"float32","format":"DefaultFormat","shape":[120],"tensor_name":"output_0_0"}],"platform":"AKG","process":"cuda","target_info":{"compute_capability":"8.6","sm_count":30},"version":1}! build attrs: None
Traceback (most recent call last):
File "/home/wq/workspace/official/cv/lenet/train.py", line 68, in
train_lenet()
File "/home/wq/workspace/official/cv/lenet/src/model_utils/moxing_adapter.py", line 108, in wrapped_func
run_func(*args, **kwargs)
File "/home/wq/workspace/official/cv/lenet/train.py", line 64, in train_lenet
model.train(config.epoch_size, ds_train, callbacks=[time_cb, ckpoint_cb, LossMonitor()])
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/train/model.py", line 1049, in train
initial_epoch=initial_epoch)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/train/model.py", line 98, in wrapper
func(self, *args, **kwargs)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/train/model.py", line 623, in _train
cb_params, sink_size, initial_epoch, valid_infos)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/train/model.py", line 701, in _train_dataset_sink_process
outputs = train_network(*inputs)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/nn/cell.py", line 578, in __call__
out = self.compile_and_run(*args)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/nn/cell.py", line 965, in compile_and_run
self.compile(*inputs)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/nn/cell.py", line 938, in compile
jit_config_dict=self._jit_config_dict)
File "/home/wq/miniconda3/envs/mindspore_py37/lib/python3.7/site-packages/mindspore/common/api.py", line 1137, in compile
result = self._graph_executor.compile(obj, args_list, phase, self._use_vm_mode())
RuntimeError: Response is empty
----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/backend/common/session/kernel_build_client.h:110 Response
[WARNING] MD(11335,7f5d65a54740,python):2022-08-16-19:59:29.682.440 [mindspore/ccsrc/minddata/dataset/engine/datasetops/device_queue_op.cc:75] ~DeviceQueueOp] preprocess_batch: 1; batch_queue: 0, 0, 8; push_start_time: 2022-08-16-19:59:28.360.148; push_end_time: 2022-08-16-19:59:28.528.270.
Process finished with exit code 1
是否考虑一下环境问题,因为该网络是有看护的,我们最近的看护结果正常。另外,我看到您的报错日志里面有:FileNotFoundError: [Errno 2] No such file or directory: 'nvcc': 'nvcc'。据此考虑环境配置问题,您尝试一下nvcc -v,看看是不是环境没有配置好