Fyusion
Create a 360° video
Hi. I am wondering whether your framework is able to create a 360° "surround" effect. For example, can I take pictures of a soda can from different angles as I walk around it and render a video using these pictures. I have tried so and I found that there would be a big black shadow on the edge of the video at the beginning and ending And it still looks like on a single plane. I want to know why that happens and if there is anyway I can fix this. If not, I am wondering what features of your framework hinder me to do so, that is to say, the reason why the pictures must be taken at a single plane.
You'll have to change the code that generates the new view rendering path, since the current options all assume roughly planar capture. I wrote some pointers on the relevant code in this issue. To do a 360 degree path, you'd want to pick a central viewing point (probably the centroid of your pose positions), an "up" vector, and a radius, and generate a circle of camera matrices all pointing inward toward that viewing point. The rendering code should have no problem generalizing to this type of path given sufficient density of input views.
OK, I will try that. Thanks for your answer! Moreover, when I was trying to do a 360 degree rendering, there may be some pictures that cannot be registered by colmap. In the colmap_output, some records that 'could not register. see another image' while some pictures haven't been seen for once. I suppose this is because the similarities between pictures from 360 degree are too limited. Is there a way to solve this?