nvidia-tao
nvidia-tao copied to clipboard
Nvidia TAO Maskrcnn training problem. Training is complete but Evaluation Metrics are all 0, and can not achieve right mask on inferences
I spent a long time to figure out how to run Nvidia TAO Maskrcnn training. (nvidia-tao/maskrcnn.ipynb at main · NVIDIA-AI-IOT/nvidia-tao · GitHub)
And finally, the training is complete and “[INFO] Training finished successfully” is displayed. But Evaluation Metrics are all 0, and can not achieve right mask on inferences.
• Hardware : Running TAO Toolkit on Google Colab • Network Type : Mask_rcnn • Training spec file : maskrcnn_train_resnet50.txt
• How to reproduce the issue : train_log.txt Generate_tfrecords_log.txt enviroment_setting_log.txt
Please Help ! Plenty of thanks in advance !!!