TMTrackNN icon indicating copy to clipboard operation
TMTrackNN copied to clipboard

Error when preprocessing: list index out of range

Open Czechball opened this issue 3 years ago • 3 comments

Hello, I tried to process a big batch of replays (9706 replays). I started with python3 preprocessing.py -i replays/ -o out/ and it successfully processed 3649 replays, but then failed with the following error:

multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "preprocessing.py", line 101, in process_fname
    replay_file = Gbx(fname)
  File "/home/czechball/Downloads/TMTrackNN/core/gbx.py", line 103, in __init__
    self._read_node(self.class_id, -1, bp)
  File "/home/czechball/Downloads/TMTrackNN/core/gbx.py", line 531, in _read_node
    self._read_node(_class_id, idx, bp)
  File "/home/czechball/Downloads/TMTrackNN/core/gbx.py", line 516, in _read_node
    self.read_ghost(game_class, bp)
  File "/home/czechball/Downloads/TMTrackNN/core/gbx.py", line 682, in read_ghost
    sample_sz = sample_sizes[i]
IndexError: list index out of range
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "preprocessing.py", line 145, in <module>
    entries = p.starmap(process_fname, it)
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
IndexError: list index out of range

It failed when processing this replay: 7027.Replay.Gbx.zip

I'm on Manjaro 5.8.18-1-MANJARO, my Python version is 3.8.6.

Czechball avatar Nov 08 '20 01:11 Czechball