Jacob Krantz

The instruction_id in RxR-Habitat matches to the instruction_id in RxR, so linking a pose trace to an RxR-Habitat episode should be as easy as that for Guide annotations. For Follower...

Thank you for your question. Differences between the ground truth (GT) paths and paths generated from the `VLNOracleActionSensor` exist for two reasons (primarily the first): 1. The GT path was...

The original VLN task is based on navigating from node to node on the Matterport3D graph. When we ported each trajectory to a continuous environment, we transferred not just the...

The old follower is now back 🙂 (#8). If you want it to follow the reference path, you can do something like this: https://gist.github.com/jacobkrantz/9143f4744b9e1809bb1ef0522700932b

Using Habitat v0.1.5 and `ShortestPathFollowerCompat`, I find that the GT action sequences match exactly for 95% of paths. The 5% of differences can be attributed to internal version differences in...

The pretrained models load correctly for me on the master branch. For the [rxr-habitat-challenge](/jacobkrantz/VLN-CE/tree/rxr-habitat-challenge) branch, the baseline models inherit from a base policy class that does not have `critic.*` layers....

You can save videos during agent evaluation using `VIDEO_OPTION` and `VIDEO_DIR` in your experiment config. Example: ```yaml ... VIDEO_OPTION: [disk] VIDEO_DIR: videos ... ``` https://github.com/jacobkrantz/VLN-CE/blob/5ce28a9471ad86a41aac2cf709374e3d24ccae84/vlnce_baselines/config/default.py#L19 If you want to customize...

This could be for many different reasons. Have you been able to successfully run the Habitat-Lab [example script](https://github.com/facebookresearch/habitat-lab/blob/master/examples/example.py)? The multiprocessing error could be hiding the real issue. Switching from `habitat.VectorEnv`...

You can use config options to generate a video during evaluation: https://github.com/jacobkrantz/VLN-CE/blob/2375f186cd8a1224a5ff15efa4c0ac05edfb2d42/vlnce_baselines/config/default.py#L23-L24 If you want to update the way in which frames are produced, you can modify/replace the functions in...

Heads up for those playing with this branch -- currently incompatible with hab sim nightly due to the magnum update. https://github.com/facebookresearch/habitat-lab/pull/1776