POP3D icon indicating copy to clipboard operation
POP3D copied to clipboard

About inference and training

Open ttomtom6 opened this issue 2 years ago • 7 comments

Thanks for your great work! It really helps me a lot. When I run eval.py, only the val_miou_vox_agn can be obtained withou the val_miou_vox_clip_all in the instruction. Is there something wrong here? Additionally, there seems to be a missing part (text embedding model) in the training code. Can this part be uploaded as well?

ttomtom6 avatar Jan 02 '24 12:01 ttomtom6

Hi, sorry for this, I added val_miou_vox_clip_all to print. Also, what do you mean by "text embedding model"?

vobecant avatar Jan 02 '24 14:01 vobecant

Thanks your reply! Yes, I want to retrain this excellent model on other datasets but this model is missing. It would be great if the whole training pipeline is provided.

ttomtom6 avatar Jan 02 '24 14:01 ttomtom6

If I understand it correctly, you want to know how to generate the text embeddings for the classes you want to evaluate. We have an example of how do we generate these embeddings for nuScenes in MaskCLIP/tools/maskclip_utils/prompt_engineering.py. If you want to use a different set of classes, you need to define such set and generate these embeddings using this script.

vobecant avatar Jan 02 '24 14:01 vobecant

Thanks your reply!

ttomtom6 avatar Jan 03 '24 14:01 ttomtom6

Hi, I encountered an error when running eval.py. The error location is as follows: grid_ind_float_features = self.voxelization(xyz[matching_points]) *** IndexError: only integers, slices (:), ellipsis (...), numpy.newaxis (None) and integer or boolean arrays are valid indices My matching_points is a list of length 6, xyz is an array of size (34720, 3) Please tell me how to fix it. @vobecant @ttomtom6

RikkiXu avatar Jan 06 '24 07:01 RikkiXu

Hi @RikkiXu , thank you for your interest in our code. I am sorry, but I don't know how to help you as the code works fine on my side. @ttomtom6 , did you encounter any problems like this? Thanks!

vobecant avatar Jan 06 '24 23:01 vobecant

Hi @RikkiXu , I am sorry that I haven't encountered this issue. Perhaps you need to check your environment.

ttomtom6 avatar Jan 10 '24 14:01 ttomtom6

Dear @RikkiXu, since @ttomtom6 did not encounter the same issue as you did, I think that the problem is really in your environment.

vobecant avatar Aug 13 '24 09:08 vobecant