goat-bench icon indicating copy to clipboard operation
goat-bench copied to clipboard

Will the pure language navigation dataset be released?

Open ConnerQiu opened this issue 1 year ago • 4 comments

Thanks for the great work!!

In the script of "1-languagenav-eval.sh" I saw a path of "DATA_PATH="data/datasets/languagenav/hm3d/v5_final/". Seems like there is pure language nav dataset that only contains the language dataset. I wonder will this dataset be released.

Or maybe put it in this ways, is there other way to let the agent be only trained/evaluated with language description as the goal, rather than with different types in sequence.

ConnerQiu avatar Jun 20 '24 02:06 ConnerQiu

@ConnerQiu you should be able to extract the episodes for LanguageNav from GOAT-Bench dataset for now. I will work towards publishing the LanguageNav episode dataset separately to HF and add relevant data loading instructions to the repo.

Ram81 avatar Jul 09 '24 17:07 Ram81

@Ram81 Ram, thanks for the reply and work on releasing the dataset~

ConnerQiu avatar Jul 10 '24 05:07 ConnerQiu

Please also let me know if the pure dataset published, thanks! @Ram81

ybgdgh avatar Jul 24 '24 23:07 ybgdgh

Reopening this issue to keep track of release. @ConnerQiu @ybgdgh I'll keep you posted on the timeline here.

Ram81 avatar Aug 01 '24 17:08 Ram81