models icon indicating copy to clipboard operation
models copied to clipboard

How to distinguish training vs validation loss from tensorboard

Open cute-tiger opened this issue 4 years ago • 5 comments

When use the" tensorflow object detection api "to training a detection model, and use the recommended directory structure to run tensorboard,command line is tensorboard --logdir=${MODEL_DIR}.

it's output is this image:it have many loss function. Are these loss from training or validation process? If these are from training process only, how to check validation loss using tensorboard? Screen Shot 2020-03-08 at 9 30 40 PM

cute-tiger avatar Mar 24 '20 14:03 cute-tiger

If you're using the latest TensorFlow Object Detection API (using model_main.py and not train.py), then the Validation Loss can be found under 'loss' and the Training Loss is under 'loss_1' or 'loss_2'.

Losses

divyanshusharma1709 avatar Mar 25 '20 04:03 divyanshusharma1709

Do we have to pass a special validation flag or a file for it to separate out the cross validation data? In our case, even though the validation loss is low, we don't see good generalization.

Screen Shot 2020-04-15 at 7 47 03 PM Screen Shot 2020-04-15 at 7 47 09 PM

tispratik avatar Apr 16 '20 02:04 tispratik

@divyanshusharma1709 In my case only the loss tag is present, no Loss1 or Loss2, Is i am missing something? please help image

ojasvisancheti avatar Jun 14 '21 14:06 ojasvisancheti

I'm not seeing loss_1 and loss_2. I'm only getting a tab called loss.

loss

what am i missing? is there any parameter required to pass in order to get both train and validation loss in tensorboard?

kabyanil avatar Oct 29 '21 04:10 kabyanil

I'm having the same issue (using model_main.py) that i have multiple losses (i.e. classification loss, localization loss, total loss etc.) but no two curves as @divyanshusharma1709.

markusbink avatar Dec 14 '22 22:12 markusbink