Rui Chen

Results 55 comments of Rui Chen

@ashawkey Actually, I used random backgrounds referring to CLIPMesh, including checkerboard, blurred Gaussian, and so on. But I found it easily bake the background color to the diffuse map in...

One option is to use the appearance modeling of [Fantasia3D](https://github.com/Gorilla-Lab-SCUT/Fantasia3D). However, it should be noted that the official implementation does not specifically optimize for a single GPU.

1、Installing xformers can greatly reduce memory usage. 2、Use gradient accumulation technology that is easy to implement as illustrated in [threestudio](https://github.com/threestudio-project/threestudio/blob/main/README.md?plain=1#L568) 3、https://github.com/threestudio-project/threestudio/blob/main/README.md?plain=1#L575 4、[rent](https://www.autodl.com/home) 5、I think 4 GPUs are enough to reproduce...

OK. I will take some time to test it. Please be patient.

There are two ways to achieve that: 1、Optimization in 3d appearance field. Before that, you need an initial appearance reconstruction process. You can refer to https://github.com/DSaurus/threestudio-meshfitting or https://github.com/NVlabs/nvdiffrec/blob/main/geometry/dmtet.py 2、Optimization in...

Could you provide the configuration file and the number of GPUs used?

"a full body photo of a girl wearing a mecha" There are still some issues with avatar's face and hands, and I will optimize them accordingly. https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/f68ecd26-960b-47c2-b58e-50f54db808f0

It seems to be due to some bias towards female roles in stable diffusion 2.1. I can easily generate the 3D of Naruto, but it is more difficult to generate...

"Michelangelo style statue of dog reading news on a cellphone" performance: 15 minutes for geometry modeling and 13 minutes for appearance modeling on 8 3090 GPUs resolution: 256 https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/a0d6fe70-b055-44a9-a34d-1449672dca7f https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/ed0c303c-7554-4589-a1f5-56c9c1916aef

"A highly detailed sandcastle" performance: 15 minutes for geometry modeling and 13 minutes for appearance modeling on 8 3090 GPUs resolution: 256 https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/c9867d8e-8e61-4a09-afd2-5599d6a85074 https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/01b1cc2c-5c5f-478a-83d0-1dd0ae2ee9e2 https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/0a909afb-e18c-4450-8ac8-35d50ced754a https://github.com/Gorilla-Lab-SCUT/Fantasia3D/assets/128572637/dcc5c159-fc3e-4eb8-9017-72153196f5b4