tensorflow.python.framework.errors_impl.DataLossError:报错信息处理

tensorflow.python.framework.errors_impl.DataLossError:

用Openpcdet 里面的 waymo转 kitti 遇到的错误

下面展示一些 报错信息。

Traceback (most recent call last):
  File "/home/kaai/anaconda3/envs/openpcdet2/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/kaai/openpcdet2/OpenPCDet/pcdet/datasets/waymo/waymo_utils.py", line 221, in process_single_sequence
    for cnt, data in enumerate(dataset):
  File "/home/kaai/.local/lib/python3.8/site-packages/tensorflow/python/data/ops/iterator_ops.py", line 761, in __next__
    return self._next_internal()
  File "/home/kaai/.local/lib/python3.8/site-packages/tensorflow/python/data/ops/iterator_ops.py", line 744, in _next_internal
    ret = gen_dataset_ops.iterator_get_next(
  File "/home/kaai/.local/lib/python3.8/site-packages/tensorflow/python/ops/gen_dataset_ops.py", line 2728, in iterator_get_next
    _ops.raise_from_not_ok_status(e, name)
  File "/home/kaai/.local/lib/python3.8/site-packages/tensorflow/python/framework/ops.py", line 6897, in raise_from_not_ok_status
    six.raise_from(core._status_to_exception(e.code, message), None)
  File "<string>", line 3, in raise_from
tensorflow.python.framework.errors_impl.DataLossError: corrupted record at 423579003 [Op:IteratorGetNext]

修改代码
下面展示一些 修改部分。
在 waymo_utils.py 文件里面

   205 dataset = tf.data.TFRecordDataset(str(sequence_file), compression_type='')
   206 dataset = dataset.apply(tf.data.experimental.ignore_errors()) # new

解决思路来源

https://github.com/tensorflow/tensorflow/issues/13463

如果你想知道那些文件报错

https://github.com/tensorflow/tensorflow/issues/25700

希望能够帮助到你