mvsplat icon indicating copy to clipboard operation
mvsplat copied to clipboard

Expanding to Autonomous Driving Datasets

Open wendy0527 opened this issue 1 year ago • 2 comments

Hello, I would like to know if it's possible to extend MVSplat to autonomous driving datasets like nuScenes, where there are multiple camera images at each moment with a small overlapping area between each pair. If so, would you recommend training the model with: all camera images from each moment as the context input, or only the overlapping images between each pair of cameras?

wendy0527 avatar Jul 10 '24 10:07 wendy0527

Hi @wendy0527, I do not yet have experience working with nuScenes. But you are welcome to try our MVSplat on any related new datasets, and we are more than happy to help. I would suggest you only use image pairs with overlapping regions since image pairs with no overlap might harm the effectiveness of cost volume.

donydchen avatar Jul 15 '24 10:07 donydchen

Hello, I would like to know if it's possible to extend MVSplat to autonomous driving datasets like nuScenes, where there are multiple camera images at each moment with a small overlapping area between each pair. If so, would you recommend training the model with: all camera images from each moment as the context input, or only the overlapping images between each pair of cameras?

Have you tried successfully?

Mr-ind1fferent avatar Sep 18 '24 13:09 Mr-ind1fferent