speaker_follower icon indicating copy to clipboard operation
speaker_follower copied to clipboard

Visualization Code

Open Mrs-Hudson opened this issue 7 years ago • 13 comments

Hi In https://arxiv.org/pdf/1806.02724.pdf, there are some visualizations of the predicted trajectories in Fig 4. Is the code to generate these available?

Mrs-Hudson avatar Oct 25 '18 16:10 Mrs-Hudson

Hi, we used a Jupyter notebook to visualize the trajectories. Here is the notebook we used: https://gist.github.com/ronghanghu/d250f3a997135c667b114674fc12edae

ronghanghu avatar Oct 27 '18 18:10 ronghanghu

Thanks a lot! Do you also have a notebook for the top down trajectory views?

Mrs-Hudson avatar Oct 27 '18 18:10 Mrs-Hudson

For that part, we don't have an automated script to generate them (but we loaded them in web browser and screenshot them).

This 3D.zip is a javascript webGL script from Peter Anderson (the Room-to-Room dataset author) to load the Matterport3D meshgrid, and we used it for our top-down visualization.

ronghanghu avatar Oct 27 '18 18:10 ronghanghu

Thanks! In case you have any other ad hoc scripts for visualization and error analysis, it would be really helpful!

Also, how have you used the 3D.zip to visualize true vs predicted paths?

Mrs-Hudson avatar Nov 02 '18 01:11 Mrs-Hudson

Hi @ronghanghu, I would like to second the request here. Can you give a little more instructions on how to use the 3D.zip code to visualize the top-down view? Thanks!

eric-xw avatar Nov 12 '18 07:11 eric-xw

Hi, to run the 3D visualizer, one would need to:

  • download the meshgrid data of Matterport3D
  • add the .js extension to files in the js directory
  • set data and file paths in js/CheckConnectivity.js to your local directories with the textured meshes and connectivity graphs
  • start a local http server with something like python -m SimpleHTTPServer, and browse to http://localhost:8000/connectivity.html

It should be possible to move around the environment by dragging the screen and clicking blue cylinders. (The code is quite hacky -- it tries to load the whole environment textured mesh in the browser - for large environments, this can take a long time or crash.)

ronghanghu avatar Nov 13 '18 05:11 ronghanghu

Hello @ronghanghu, I tried to run the 3D visualizer but I cant find the file mesh_names.json which is needed in CheckConnectivity.js. Do you know where I can download it?

Thanks!

michelm117 avatar Feb 20 '19 17:02 michelm117

@michelm117 Hi, did you find the mesh_names.json files finally? I am also confused with this problem.

zwx8981 avatar Oct 23 '19 03:10 zwx8981

I want to generate pano images from skybox but I don't know how. Can someone help?

winnechan avatar Oct 31 '19 13:10 winnechan

Hello @ronghanghu, I tried to run the 3D visualizer but I cant find the file mesh_names.json which is needed in CheckConnectivity.js. Do you know where I can download it?

Thanks!

Same issue here. Has anyone been able to get that mesh_names.json file?

rmant avatar May 29 '20 19:05 rmant

Hi, we used a Jupyter notebook to visualize the trajectories. Here is the notebook we used: https://gist.github.com/ronghanghu/d250f3a997135c667b114674fc12edae

Hi,the website providing trajectory data cannot be accessed.

panorama trajectories available in

http://gpu.ronghanghu.com/misc/text_navi/eval_outputs/selfplay_glove_sample_pragmatics_40_state_factored/

image

wangqian621 avatar Apr 30 '22 12:04 wangqian621

Hello @ronghanghu, I tried to run the 3D visualizer but I cant find the file mesh_names.json which is needed in CheckConnectivity.js. Do you know where I can download it? Thanks!

Same issue here. Has anyone been able to get that mesh_names.json file?

Hi! I met the same problem. Have you found out how to visualize the top-down map, connectivities and the predicted trajectories?

Thanks a lot!

zhangjb416 avatar Jun 05 '23 06:06 zhangjb416

你好@ronghanghu, 我尝试运行 3D 可视化工具,但找不到_CheckConnectivity.js_中所需的文件_mesh_names.json_。你知道我可以在哪里下载吗? 谢谢!__

这里同样的问题。有人能够获取该 mesh_names.json 文件吗?

你好!我遇到了同样的问题。您是否知道如何可视化自上而下的地图、连接性和预测轨迹?

多谢!

the same problem .. Hope some one to help.

bxrjmfh avatar Oct 14 '23 07:10 bxrjmfh