habitat-lab
habitat-lab copied to clipboard
Inconsistent episode ids between validation sets of pointnav_gibson_v1.zip and pointnav_gibson_v2.zip
❓ Questions and Help
Within the validation splits of the v1 and v2 datasets for pointnav_gibson, the episode_ids are inconsistent; for v1, once the scenes are sorted alphabetically by name, the 994 episode are numbered from 0 to 993, while the episodes in the v2 validation split are numbered from 0-70 for each of the 14 scenes.
Is it possible to mention this in the README, or to change one of the two to match the other? I got tripped up trying to run the evaluation script on v2 as my data was being overwritten as the same episode_ids were being seen multiple times across the same pass on the validation set.
Thanks. Can you please send a PR to the README?