InstantMesh icon indicating copy to clipboard operation
InstantMesh copied to clipboard

Question about parameters

Open masonintokyo opened this issue 1 year ago • 4 comments

I noticed that the texture quality of my output did not meet my expectations, especially when compared to the demo results which looked significantly better.

Could you please help me understand which parameters might influence the texture quality? Additionally, I would like to know the specific parameters used in the demo for comparison.

Here are the default parameters I used:

model_config:
  target: src.models.lrm_mesh.InstantMesh
  params:
    encoder_feat_dim: 768
    encoder_freeze: false
    encoder_model_name: facebook/dino-vitb16
    transformer_dim: 1024
    transformer_layers: 16
    transformer_heads: 16
    triplane_low_res: 32
    triplane_high_res: 64
    triplane_dim: 80
    rendering_samples_per_ray: 64
    grid_res: 128
    grid_scale: 2.1


infer_config:
  unet_path: ckpts/diffusion_pytorch_model.bin
  model_path: ckpts/instant_mesh_large.ckpt
  texture_resolution: 1024
  render_resolution: 1024

Input image megmin-rembg

Result スクリーンショット 2024-04-22 073417

Any guidance or suggestions would be greatly appreciated!

Thank you for your time and assistance.

masonintokyo avatar Apr 21 '24 22:04 masonintokyo

It's indeed due to the unsatisfying human body/face generation capability of Zero123++, which leads to distortions and multi-view inconsistency. Please try using front-view images as input.

bluestyle97 avatar Apr 23 '24 07:04 bluestyle97

I know the issue is answered but i'm also interested to know which paramters can I change to have a better quality meshes !

Thank you for your time and assistance

PierreBEGOUT avatar Apr 26 '24 14:04 PierreBEGOUT

@bluestyle97 iso-surface extraction resolution is 256 with higher value would help here ?

sumanttyagi avatar May 08 '24 08:05 sumanttyagi

@sumanttyagi And where is this parameter, I can't find it anywhere.

PierreBEGOUT avatar May 13 '24 10:05 PierreBEGOUT