[Speculative] Load 3D Street View Dataset with Habitat-Sim

[dhruvbatra]

🚀 Feature

[Not really a feature request for Habitat-Sim; more like a data preprocessing wish-list]

3D Street View dataset by Zamir et al. ECCV16 provides (untextured) 3D models for 8 cities and 25M registered images (with 6DOF pose and other meta-data).

It would be quite valuable to use the registered images to create textured meshes of the 8 cities and convert into gltf or obj format to be loaded with Habitat.

Motivation

Right now, all of Habitat's 3D data sources are interior spaces (homes, offices, building, etc). Creating this textured mesh of cities will (a) enable us and others to study outdoor navigation, and (b) provide a challenging rendering/simulation test-bed (I imagine these meshes will be much larger than the ones we are used to working with).

Additional context

Suggestion from a chat with Amir. Relevant links:

https://github.com/amir32002/3D_Street_View http://3drepresentation.stanford.edu/