MeshAnything icon indicating copy to clipboard operation
MeshAnything copied to clipboard

support for >800 faces

Open yosun opened this issue 1 year ago • 10 comments

seriously.

yosun avatar Jun 25 '24 22:06 yosun

It takes more computation resources for more faces.

buaacyw avatar Jun 26 '24 01:06 buaacyw

it's useless for 800 faces since when u want to convert a bad 3d scanned mesh to "artist made", you start with a high poly mesh

yosun avatar Jun 26 '24 04:06 yosun

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

buaacyw avatar Jun 26 '24 15:06 buaacyw

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

Is there any type of continued pretraining or finetuning we could do to achieve > 800?

matbeedotcom avatar Jun 27 '24 04:06 matbeedotcom

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

well, you're certainly great at marketing, even if your research is basically a toy project.

i don't understand why people are excited by the results when existing procedural mesh cleanup techniques are cheaper, faster, and more useful than this.

yosun avatar Jun 27 '24 06:06 yosun

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

Is there any type of continued pretraining or finetuning we could do to achieve > 800?

Hi! Thanks for your interest. Like LLMs, simply prolong the size of positional encoding vector and train the model on a mesh dataset with meshes more than 800 faces.

buaacyw avatar Jun 27 '24 06:06 buaacyw

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

well, you're certainly great at marketing, even if your research is basically a toy project.

i don't understand why people are excited by the results when existing procedural mesh cleanup techniques are cheaper, faster, and more useful than this.

May I ask which specific methods are referred to by 'existing procedural mesh cleanup techniques'? I will make sure to study them thoroughly.

buaacyw avatar Jun 27 '24 06:06 buaacyw

i'm not sure at what level to start the discussion.

here is a very old demo (no it's not the gen AI InstantMesh from tencent) - it's any mesh to smooth quads from 10 years ago: https://github.com/wjakob/instant-meshes

since then, there have been many advances in procedural non-AI (cheap computationally, consumer GPU takes ms etc) conversion of messy meshes to smooth quads...

in this context, it would be great to see how the results of your solution compare to existing procedural mesh solutions.

hope that by sharing some oldskool techniques, we can more sooner get to the common industry use cases of generated meshes with 800+ faces being usable in your solution.

yosun avatar Jul 10 '24 06:07 yosun

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

Is there any type of continued pretraining or finetuning we could do to achieve > 800?

Hi! Thanks for your interest. Like LLMs, simply prolong the size of positional encoding vector and train the model on a mesh dataset with meshes more than 800 faces.

Curious if you've outlined a strategy for doing this?

Perhaps we could do some mass scraping of free 3d models. I have 3 gigabit internet + 100tb of disk space, and experience in scraping.

matbeedotcom avatar Jul 10 '24 15:07 matbeedotcom

This is an academic project; you can't expect it to go from nothing to industry use overnight, right?

Is there any type of continued pretraining or finetuning we could do to achieve > 800?

Hi! Thanks for your interest. Like LLMs, simply prolong the size of positional encoding vector and train the model on a mesh dataset with meshes more than 800 faces.

Curious if you've outlined a strategy for doing this?

Perhaps we could do some mass scraping of free 3d models. I have 3 gigabit internet + 100tb of disk space, and experience in scraping.

Thanks for reaching out, but I think ObjaverseXL already has enough 3D models for training.

buaacyw avatar Jul 11 '24 09:07 buaacyw