habitat-lab icon indicating copy to clipboard operation
habitat-lab copied to clipboard

Inconsistent episode ids between validation sets of pointnav_gibson_v1.zip and pointnav_gibson_v2.zip

Open naokiyokoyama opened this issue 4 years ago • 1 comments

❓ Questions and Help

Within the validation splits of the v1 and v2 datasets for pointnav_gibson, the episode_ids are inconsistent; for v1, once the scenes are sorted alphabetically by name, the 994 episode are numbered from 0 to 993, while the episodes in the v2 validation split are numbered from 0-70 for each of the 14 scenes.

Is it possible to mention this in the README, or to change one of the two to match the other? I got tripped up trying to run the evaluation script on v2 as my data was being overwritten as the same episode_ids were being seen multiple times across the same pass on the validation set.

naokiyokoyama avatar Jan 19 '21 16:01 naokiyokoyama

Thanks. Can you please send a PR to the README?

dhruvbatra avatar Jan 19 '21 17:01 dhruvbatra