goat-bench Unable to run ```SenseAct-NN Skill-Chain Baseline``` evaluation.

I'm unable to run the evaluation of the SenseAct-NN Skill-Chain Baseline (eval code at the end of the README)

Content of data/goat-assets/checkpoints/sense_act_nn_skill_chain is only language_nav_ckpt.pth. See here - HF.

When running the code, I got the following error:

File goat_bench/models/high_level_policy.py", line 124, in __init__
    self.ovon_policy = ovon_policy_cls.from_config(
AttributeError: 'NoneType' object has no attribute 'from_config'

Indeed, ovon_policy_cls should be

ovon_policy_cls = baseline_registry.get_policy(
            "PointNavResnetCLIPPolicy"
        )

but PointNavResnetCLIPPolicy it is not registered. It seems to be refactored to GOATPolicy, correct me if I'm wrong. However, If I replace PointNavResnetCLIPPolicy with GOATPolicy , several model keys seem to be missing. Indeed, I have the following error:

FileNotFoundError: [Errno 2] No such file or directory: 'data/new_checkpoints/ovon/ver/resnetclip_rgb_text/seed_1/ckpt.121.pth'

Sep 20 '24 15:09 francescotaioli

same issue with me

Sep 21 '24 20:09 rtabrizi

It also seems that language_nav_ckpt.pth is serialized with the old module name goat

Sep 22 '24 13:09 francescotaioli

@francescotaioli have you had any luck?

Sep 24 '24 16:09 rtabrizi

@rtabrizi Nope, unfortunately, I could not run it, and in the meantime, I was focusing on other things. Hope they will release the new checkpoints. @Ram81, do you have any updates on this, by any chance?

Sep 25 '24 06:09 francescotaioli

@Ram81 are you able to upload the correct checkpoint?

Sep 26 '24 21:09 rtabrizi

@rtabrizi @francescotaioli you are right. The checkpoints are outdated. I'll push the fixed version by the end of this week. Sorry about that