SMALify
SMALify copied to clipboard
benjiebob
suggestion for documentation/guidance for another animal species
Would it be possible to add instruction or guidance on how to reproduce this job for another animal species?
Thanks for the feedback. In theory you should just need to change the SHAPE_FAMILY. Should have docs updated in next couple of days...
Hi, the 5 animal classes, defined by the SMAL model (https://smal.is.tue.mpg.de/toys.html), are cats, dogs, cows, horses and hippos. I'd think dogs have the most similar shape, but you can look through the toys in the link above and see if there is one you think is particularly close.
Hi, thanks for the reply.
- It appears that the "dog" category only features thin animals. I also tried "cats" and "hippos" but not work.
- In your paper, you showed results related to bears. I've been unable to generate reasonable results for bears and hypothesize that this may be due to the model being SMAL rather than SMALR. Could you please confirm if my understanding is correct? Thank you.
- If my assumption about the use of SMAL rather than SMALR is correct, would it be possible to implement SMALR in either this repository or a new one? Thank you.
We do use the SMAL model in the Creatures Great and SMAL paper, and initialize bears from the dog category.
In our paper, we mention the refinement step from SMALR and that we don't use it.
This work was recently extended 12 with a refinement step that optimizes over model vertex positions. This can be considered independent to the initial SMAL model fit and would be trivial to add to our method.
In your examples, it looks like either your shape prior weight is too high or your silhouette loss weight is too low. If you play with these weights, you should be able to get a 3D fit that matches the outline of the bear. You can see my attempt in our video.
I see. Thank you very much for your reply and suggestions. I'll try your advice about adjusting the weights and will create a new closed issue in the future if I achieve success.