VLN-CE icon indicating copy to clipboard operation
VLN-CE copied to clipboard

Vision-and-Language Navigation in Continuous Environments using Habitat

Results 25 VLN-CE issues
Sort by recently updated
recently updated
newest added

![image](https://user-images.githubusercontent.com/3351143/112843867-9a46a480-90ea-11eb-9202-53d64765fe04.png) After I installed habitat-sim, habitat-lab and VLN-CE in the README.md successfully, and run the command "python run.py --exp-config vlnce_baselines/config/rxr_configs/rxr_cma_en.yaml --run-type train", I got this error. Did I do something...

So I trained a basic seq2seq model resulting with 15 checkpoints named ckpt.{num}.pth. I modified the `NUM_PROCESSES` filed to `4` and it takes about one day to train on a...

Hi, Jacobkrantz ~ How do you render the 'gif' performed in the readme file? I want to see what the agents was doing closely for each action within the reconstructed...

Hi, I feel quite confused about the dataset. In the vlnce gt dataset, there is locations and actions sequence, however when I use the simulator there is "vlnce-oricle action" in...

Hello, I am working in ML, but I am new to Habitat. I'm slightly confused about the purpose of some files: hierarchical_trainer.py, nonlearning_agents.py, and robo_vln_trainer.py. From my understanding, these files...

Hi Jacob, I found that the image quality rendered by Habitat seems to be inferior to that of the MP3D simulator. Do you have any suggestions for improving the image...

![demo](https://github.com/jacobkrantz/VLN-CE/assets/81406713/fd9bc81a-8bcf-4032-92a0-9ba7c2bcd90a) ![example2](https://github.com/jacobkrantz/VLN-CE/assets/81406713/ba9e0732-646e-4b1b-a4b0-469d6f6ab9b0) Could you provide me with the code in the image above "Generate a video of a robot navigating with natural language guidance based on baseline"?

I have tested the [Decision Transformer](https://arxiv.org/abs/2106.01345) in VLN-CE. While the results were underwhelming, it might still be interesting to integrate this into the main code base. It shows a working...

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.13.1 to 2.11.1. Release notes Sourced from tensorflow's releases. TensorFlow 2.11.1 Release 2.11.1 Note: TensorFlow 2.10 was the last TensorFlow release that supported GPU on native-Windows. Starting...

dependencies