No such file or directory：segment-10485926982439064520_4980_000_5000_000_with_camera_labels_with_camera_labels.tfrecord

[XuMian-xm]

Traceback (most recent call last): File "/root/miniconda3/envs/detzero/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/root/miniconda3/envs/detzero/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "/root/DetZero/detection/detzero_det/datasets/waymo/waymo_preprocess.py", line 241, in create_waymo_infos( File "/root/DetZero/detection/detzero_det/datasets/waymo/waymo_preprocess.py", line 70, in create_waymo_infos waymo_infos_train = get_infos_worker( File "/root/DetZero/detection/detzero_det/datasets/waymo/waymo_preprocess.py", line 36, in get_infos_worker sequence_infos = list(tqdm(executor.map(process_single_sequence, sample_sequence_file_list), File "/root/miniconda3/envs/detzero/lib/python3.8/site-packages/tqdm/std.py", line 1181, in iter for obj in iterable: File "/root/miniconda3/envs/detzero/lib/python3.8/concurrent/futures/_base.py", line 619, in result_iterator yield fs.pop().result() File "/root/miniconda3/envs/detzero/lib/python3.8/concurrent/futures/_base.py", line 444, in result return self.__get_result() File "/root/miniconda3/envs/detzero/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/root/miniconda3/envs/detzero/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(*self.args, **self.kwargs) File "/root/DetZero/detection/detzero_det/datasets/waymo/waymo_utils.py", line 206, in process_single_sequence_and_save process_single_tfrecord_multiprocessing( File "/root/DetZero/detection/detzero_det/datasets/waymo/waymo_utils.py", line 250, in process_single_tfrecord_multiprocessing for cnt, data in enumerate(dataset): File "/root/miniconda3/envs/detzero/lib/python3.8/site-packages/tensorflow/python/data/ops/iterator_ops.py", line 761, in next return self._next_internal() File "/root/miniconda3/envs/detzero/lib/python3.8/site-packages/tensorflow/python/data/ops/iterator_ops.py", line 744, in _next_internal ret = gen_dataset_ops.iterator_get_next( File "/root/miniconda3/envs/detzero/lib/python3.8/site-packages/tensorflow/python/ops/gen_dataset_ops.py", line 2728, in iterator_get_next _ops.raise_from_not_ok_status(e, name) File "/root/miniconda3/envs/detzero/lib/python3.8/site-packages/tensorflow/python/framework/ops.py", line 6897, in raise_from_not_ok_status six.raise_from(core._status_to_exception(e.code, message), None) File "", line 3, in raise_from tensorflow.python.framework.errors_impl.NotFoundError: /root/DetZero/data/waymo/raw_data/segment-10485926982439064520_4980_000_5000_000_with_camera_labels_with_camera_labels.tfrecord; No such file or directory [Op:IteratorGetNext]

[FileCrasher]

Hi, I met this problem too , and figured this out by changing line 189

sequence_file_tfrecord = sequence_file[:-9] + '_with_camera_labels.tfrecord'

in DetZero/detection/detzero_det/datasets/waymo/waymo_utils.py with

if sequence_name.endswith('_with_camera_labels'):
        sequence_file_tfrecord = sequence_file  
    else:
        sequence_file_tfrecord = sequence_file.replace('.tfrecord', '_with_camera_labels.tfrecord')

You can see a duplicate concatenation in the file path, in with_camera_labels_with_camera_labels.tfrecord where with_camera_labels was concatenated twice.

[TangAL0203]

good for me!!!