ComfyUI-3D-Pack icon indicating copy to clipboard operation
ComfyUI-3D-Pack copied to clipboard

Use our own images of 4 angles with large multiview gaussian model ?

Open al3dv2 opened this issue 1 year ago • 7 comments

It would be great if we could use our own images of 4 angles with large multiview gaussian model, someone know how to do it in comfyui ?

al3dv2 avatar Feb 10 '24 07:02 al3dv2

Just replace the input images to large multiview gaussian model with your own images and that's it.

For the best result make sure:

  1. your multiview images height == width
  2. your images is in correct view order (you can check with preview image node)

MrForExample avatar Feb 10 '24 08:02 MrForExample

I tried but I've a error message when I put the input directly on the multiview gaussian model : 3mv 2mv 1mv

al3dv2 avatar Feb 10 '24 10:02 al3dv2

Apparently it's a size problem I've try 512x512 and 256x256 but still the same error message, also is it possible to change the seed ? thanks

al3dv2 avatar Feb 10 '24 10:02 al3dv2

I put a image example I've generate with sd if you want to try

opaciterversion

al3dv2 avatar Feb 10 '24 11:02 al3dv2

You get input size mismatch problem error, because you are loading a single image instead of four images, if you preview the output of the MVDreamer Model node you'll see what it meant, You need to use load images node instead of load image. something like this: Screenshot 2024-02-10 173941 And put your images inside the corresponding input folder in a correct order

MrForExample avatar Feb 10 '24 16:02 MrForExample

Thanks it's works !

al3dv2 avatar Feb 10 '24 17:02 al3dv2

Just a last question do you know how I can change the seed and the inference steps ? thanks

al3dv2 avatar Feb 10 '24 17:02 al3dv2

Just a last question do you know how I can change the seed and the inference steps ? thanks

About inference steps, there is no inference steps parameters in LGM, its Asymmetric U-Net did not use denoise but predict gaussians features in one pass.

About seed, I believe we can add seed to the MVDreamer but not LGM (again, since there is no denoise), I'll add it to the project in the next update

Cheers friend, thanks for the effort, have a good day 👍

MrForExample avatar Feb 11 '24 10:02 MrForExample