DataFlow函数如上,是子类和父类出问题了吗?
具体报错:
2020-06-13 03:58:51.503649: I tensorflow/stream_executor/platform/default/http://dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1
DataFlow
case: 1, logdir: /data/private/vc/logdir/1/train1
hp.train1.data_path /data/private/vc/datasets/timit/TIMIT/TRAIN/*/*/*.wav hp.train1.batch_size 32
[0613 03:59:00 @logger.py:128]WRN Log directory /data/private/vc/logdir/1/train1 exists! Use 'd' to delete it.
[0613 03:59:00 @logger.py:131]WRN If you're resuming from a previous run, you can choose to keep it. Press any other key to exit. Select Action: k (keep) / d (delete) / q (quit):d [0613 03:59:25 @logger.py:92] Argv: train1.py 1
[0613 03:59:25 @parallel.py:219] [MultiProcessRunner] Will fork a dataflow more than one times. This assumes the datapoints are i.i.d.
[0613 03:59:25 @argtools.py:138]WRN Starting a process with 'fork' method is not safe and may consume unnecessary extra CPU memory. Use 'forkserver' or 'spawn' method (available after Py3.4) instead if you run into any issues. See https://docs.python.org/3/library/multiprocessing.html#contexts-and-start-methods on how to set them.
[0613 03:59:25 @argtools.py:138]WRN "import prctl" failed! Install python-prctl so that processes can be cleaned with guarantee.
self
self.wav_files [] Process _Worker-1: self
self.wav_files [] Process _Worker-2: self
self.wav_files []
Process _Worker-3: [0613 03:59:25 @training.py:48] [DataParallel] Training a model of 2 towers.
[0613 03:59:25 @interface.py:41] Automatically applying StagingInput on the DataFlow.
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap self.run()
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/parallel.py", line 192, in run for dp in self.ds:
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/common.py", line 120, in __iter__ for data in self.ds:
File "/content/drive/Colab Notebooks/data_load.py", line 39, in get_data wav_file = random.choice(self.wav_files)
File "/usr/lib/python3.6/random.py", line 260, in choice
raise IndexError('Cannot choose from an empty sequence') from None IndexError: Cannot choose from an empty sequence Traceback (most recent call last):
File "train1.py", line 85, in
self
self.wav_files []
Process _Worker-4: Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap self.run()
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/parallel.py", line 192, in run for dp in self.ds:
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/common.py", line 120, in __iter__ for data in self.ds:
File "/content/drive/Colab Notebooks/data_load.py", line 39, in get_data
wav_file = random.choice(self.wav_files)
File "/usr/lib/python3.6/random.py", line 260, in choice
raise IndexError('Cannot choose from an empty sequence') from None IndexError: Cannot choose from an empty sequence
train(args, logdir=logdir_train1)
File "train1.py", line 64, in train Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap self.run()
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/parallel.py", line 192, in run for dp in self.ds:
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/common.py", line 120, in __iter__ for data in self.ds:
File "/content/drive/Colab Notebooks/data_load.py", line 39, in get_data
wav_file = random.choice(self.wav_files)
File "/usr/lib/python3.6/random.py", line 260, in choice
raise IndexError('Cannot choose from an empty sequence') from None
IndexError: Cannot choose from an empty sequence launch_train_with_config(train_conf, trainer=trainer)
File "/usr/local/lib/python3.6/dist-packages/tensorpack/train/interface.py", line 88, in launch_train_with_config
model.get_input_signature(), input,
File "/usr/local/lib/python3.6/dist-packages/tensorpack/utils/argtools.py", line 192, in wrapper
value = func(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorpack/train/model_desc.py", line 37, in get_input_signature inputs = self.inputs()
File "/usr/local/lib/python3.6/dist-packages/tensorpack/train/model_desc.py", line 67, in inputs
raise NotImplementedError() NotImplementedError
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap self.run()
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/parallel.py", line 192, in run for dp in self.ds:
File "/usr/local/lib/python3.6/dist-packages/tensorpack/dataflow/common.py", line 120, in __iter__ for data in self.ds:
File "/content/drive/Colab Notebooks/data_load.py", line 39, in get_data
wav_file = random.choice(self.wav_files)
File "/usr/lib/python3.6/random.py", line 260, in choice
raise IndexError('Cannot choose from an empty sequence') from None
IndexError: Cannot choose from an empty sequence