object-detection-in-keras icon indicating copy to clipboard operation
object-detection-in-keras copied to clipboard

NaN SSD Loss

Open hnushrat opened this issue 1 year ago • 0 comments

While training, loss is nan on the custom dataset.

Here is the error which is displayed: 1/562 [..............................] - ETA: 1:39:05 - loss: nanBatch 0: Invalid loss, terminating training /home/user/Shared Tasks/proj/Self_driving_cars/object-detection-in-keras/utils/bbox_utils/iou.py:31: RuntimeWarning: divide by zero encountered in true_divide res = intersect / union 562/562 [==============================] - 51s 73ms/step - loss: nan - val_loss: nan

hnushrat avatar Mar 22 '23 10:03 hnushrat