TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10
TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10 copied to clipboard
Training stops after few steps and freezes
this is what im getting in my command prompt
WARNING:tensorflow:From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:360: The name tf.losses.get_total_loss is deprecated. Please use tf.compat.v1.losses.get_total_loss instead.
W0319 04:45:37.644787 364 deprecation_wrapper.py:119] From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:360: The name tf.losses.get_total_loss is deprecated. Please use tf.compat.v1.losses.get_total_loss instead.
WARNING:tensorflow:From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:369: The name tf.summary.merge is deprecated. Please use tf.compat.v1.summary.merge instead.
W0319 04:45:37.649367 364 deprecation_wrapper.py:119] From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:369: The name tf.summary.merge is deprecated. Please use tf.compat.v1.summary.merge instead.
WARNING:tensorflow:From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:377: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.
W0319 04:45:37.660063 364 deprecation_wrapper.py:119] From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\legacy\trainer.py:377: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.
WARNING:tensorflow:From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\meta_architectures\faster_rcnn_meta_arch.py:2768: get_or_create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.get_or_create_global_step W0319 04:45:38.196037 364 deprecation.py:323] From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\meta_architectures\faster_rcnn_meta_arch.py:2768: get_or_create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.get_or_create_global_step WARNING:tensorflow:From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\utils\variables_helper.py:139: The name tf.train.NewCheckpointReader is deprecated. Please use tf.compat.v1.train.NewCheckpointReader instead.
W0319 04:45:38.199115 364 deprecation_wrapper.py:119] From C:\Users\Navin Subbu\Documents\BEEP\ML\models\research\object_detection\utils\variables_helper.py:139: The name tf.train.NewCheckpointReader is deprecated. Please use tf.compat.v1.train.NewCheckpointReader instead.
W0319 04:45:38.236440 364 variables_helper.py:157] Variable [Conv/biases/Momentum] is not available in checkpoint W0319 04:45:38.236440 364 variables_helper.py:157] Variable [Conv/weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageBoxPredictor/BoxEncodingPredictor/biases/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageBoxPredictor/BoxEncodingPredictor/weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageBoxPredictor/ClassPredictor/biases/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageBoxPredictor/ClassPredictor/weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/depthwise_weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/pointwise_weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.241039 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.246260 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249266 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.249307 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.254266 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.256379 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259411 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.259536 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.265405 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.270412 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.274866 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.279460 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.284419 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.289308 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.289308 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.289308 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.289308 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.289308 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.291385 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.291786 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.292005 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.299195 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.304188 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.304188 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.304630 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.304630 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.305629 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.305629 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.305629 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.305629 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.307262 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.307262 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.307262 364 variables_helper.py:157] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.308690 364 variables_helper.py:154] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/biases] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[360]], model variable shape: [[4]]. This variable will not be initialized from the checkpoint. W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/biases/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:154] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/weights] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[1024, 360]], model variable shape: [[1024, 4]]. This variable will not be initialized from the checkpoint. W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/weights/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:154] Variable [SecondStageBoxPredictor/ClassPredictor/biases] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[91]], model variable shape: [[2]]. This variable will not be initialized from the checkpoint. W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageBoxPredictor/ClassPredictor/biases/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:154] Variable [SecondStageBoxPredictor/ClassPredictor/weights] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[1024, 91]], model variable shape: [[1024, 2]]. This variable will not be initialized from the checkpoint. W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageBoxPredictor/ClassPredictor/weights/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.309200 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.314844 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.319368 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.324357 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W0319 04:45:38.329344 364 variables_helper.py:157] Variable [global_step] is not available in checkpoint WARNING:tensorflow:From C:\Anaconda3\envs\beep\lib\site-packages\tensorflow\contrib\slim\python\slim\learning.py:742: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession W0319 04:45:39.055290 364 deprecation.py:323] From C:\Anaconda3\envs\beep\lib\site-packages\tensorflow\contrib\slim\python\slim\learning.py:742: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession 2020-03-19 04:45:43.862930: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2 2020-03-19 04:45:43.871515: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll 2020-03-19 04:45:44.328289: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties: name: GeForce 940MX major: 5 minor: 0 memoryClockRate(GHz): 1.189 pciBusID: 0000:01:00.0 2020-03-19 04:45:44.335699: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check. 2020-03-19 04:45:44.341979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0 2020-03-19 04:45:46.990980: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix: 2020-03-19 04:45:46.997671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187] 0 2020-03-19 04:45:47.000364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0: N 2020-03-19 04:45:47.004846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1391 MB memory) -> physical GPU (device: 0, name: GeForce 940MX, pci bus id: 0000:01:00.0, compute capability: 5.0) WARNING:tensorflow:From C:\Anaconda3\envs\beep\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version. Instructions for updating: Use standard file APIs to check for files with this prefix. W0319 04:45:49.013782 364 deprecation.py:323] From C:\Anaconda3\envs\beep\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version. Instructions for updating: Use standard file APIs to check for files with this prefix. INFO:tensorflow:Restoring parameters from C:/Users/Navin Subbu/Documents/BEEP/ML/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt I0319 04:45:49.021331 364 saver.py:1280] Restoring parameters from C:/Users/Navin Subbu/Documents/BEEP/ML/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt INFO:tensorflow:Running local_init_op. I0319 04:45:50.188329 364 session_manager.py:500] Running local_init_op. INFO:tensorflow:Done running local_init_op. I0319 04:45:50.584255 364 session_manager.py:502] Done running local_init_op. INFO:tensorflow:Starting Session. I0319 04:46:14.145076 364 learning.py:754] Starting Session. INFO:tensorflow:Saving checkpoint to path training/model.ckpt I0319 04:46:14.619550 9996 supervisor.py:1117] Saving checkpoint to path training/model.ckpt INFO:tensorflow:Starting Queues. I0319 04:46:14.619550 364 learning.py:768] Starting Queues. INFO:tensorflow:global_step/sec: 0 I0319 04:46:21.284198 11640 supervisor.py:1099] global_step/sec: 0 2020-03-19 04:46:23.559595: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.05GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:23.577126: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.05GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:23.919025: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.55GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.527222: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.600998: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.673371: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.691293: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.731550: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.58GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.969436: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.76GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2020-03-19 04:46:24.986456: W tensorflow/core/common_runtime/bfc_allocator.cc:237] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.76GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. INFO:tensorflow:Recording summary at step 0. I0319 04:46:27.407880 11952 supervisor.py:1050] Recording summary at step 0. INFO:tensorflow:global step 1: loss = 0.6305 (16.277 sec/step) I0319 04:46:31.119179 364 learning.py:507] global step 1: loss = 0.6305 (16.277 sec/step) INFO:tensorflow:global step 2: loss = 0.5538 (1.783 sec/step) I0319 04:46:33.119209 364 learning.py:507] global step 2: loss = 0.5538 (1.783 sec/step) INFO:tensorflow:global step 3: loss = 1.1787 (1.685 sec/step) I0319 04:46:34.835574 364 learning.py:507] global step 3: loss = 1.1787 (1.685 sec/step) INFO:tensorflow:global step 4: loss = 0.6214 (1.468 sec/step) I0319 04:46:36.344690 364 learning.py:507] global step 4: loss = 0.6214 (1.468 sec/step) INFO:tensorflow:global step 5: loss = 0.4272 (1.516 sec/step) I0319 04:46:37.897660 364 learning.py:507] global step 5: loss = 0.4272 (1.516 sec/step) INFO:tensorflow:global step 6: loss = 0.6554 (1.585 sec/step) I0319 04:46:39.515662 364 learning.py:507] global step 6: loss = 0.6554 (1.585 sec/step) INFO:tensorflow:global step 7: loss = 0.5895 (1.611 sec/step) I0319 04:46:41.159095 364 learning.py:507] global step 7: loss = 0.5895 (1.611 sec/step) INFO:tensorflow:global step 8: loss = 0.4127 (1.711 sec/step) I0319 04:46:42.892147 364 learning.py:507] global step 8: loss = 0.4127 (1.711 sec/step) INFO:tensorflow:global step 9: loss = 0.4468 (1.959 sec/step) I0319 04:46:44.856795 364 learning.py:507] global step 9: loss = 0.4468 (1.959 sec/step) INFO:tensorflow:global step 10: loss = 0.3134 (1.197 sec/step) I0319 04:46:46.060895 364 learning.py:507] global step 10: loss = 0.3134 (1.197 sec/step) INFO:tensorflow:global step 11: loss = 0.2494 (1.628 sec/step) I0319 04:46:47.692419 364 learning.py:507] global step 11: loss = 0.2494 (1.628 sec/step) INFO:tensorflow:global step 12: loss = 0.2946 (1.685 sec/step) I0319 04:46:49.380108 364 learning.py:507] global step 12: loss = 0.2946 (1.685 sec/step) INFO:tensorflow:global step 13: loss = 0.3881 (1.385 sec/step) I0319 04:46:50.769454 364 learning.py:507] global step 13: loss = 0.3881 (1.385 sec/step) INFO:tensorflow:global step 14: loss = 0.2244 (1.313 sec/step) I0319 04:46:52.087371 364 learning.py:507] global step 14: loss = 0.2244 (1.313 sec/step) INFO:tensorflow:global step 15: loss = 0.1855 (1.623 sec/step) I0319 04:46:53.715798 364 learning.py:507] global step 15: loss = 0.1855 (1.623 sec/step) INFO:tensorflow:global step 16: loss = 0.1339 (2.177 sec/step) I0319 04:46:55.898040 364 learning.py:507] global step 16: loss = 0.1339 (2.177 sec/step) INFO:tensorflow:global step 17: loss = 0.2415 (1.543 sec/step) I0319 04:46:57.444727 364 learning.py:507] global step 17: loss = 0.2415 (1.543 sec/step) INFO:tensorflow:global step 18: loss = 0.3790 (1.376 sec/step) I0319 04:46:58.827319 364 learning.py:507] global step 18: loss = 0.3790 (1.376 sec/step) INFO:tensorflow:global step 19: loss = 0.2274 (1.303 sec/step) I0319 04:47:00.134421 364 learning.py:507] global step 19: loss = 0.2274 (1.303 sec/step) INFO:tensorflow:global step 20: loss = 0.9434 (1.683 sec/step) I0319 04:47:01.822032 364 learning.py:507] global step 20: loss = 0.9434 (1.683 sec/step) INFO:tensorflow:global step 21: loss = 0.2158 (1.789 sec/step) I0319 04:47:03.617312 364 learning.py:507] global step 21: loss = 0.2158 (1.789 sec/step) INFO:tensorflow:global step 22: loss = 0.5405 (1.405 sec/step) I0319 04:47:05.025390 364 learning.py:507] global step 22: loss = 0.5405 (1.405 sec/step) INFO:tensorflow:global step 23: loss = 0.5128 (1.871 sec/step) I0319 04:47:06.899051 364 learning.py:507] global step 23: loss = 0.5128 (1.871 sec/step) INFO:tensorflow:global step 24: loss = 0.8872 (1.416 sec/step) I0319 04:47:08.316518 364 learning.py:507] global step 24: loss = 0.8872 (1.416 sec/step) INFO:tensorflow:global step 25: loss = 0.3113 (1.526 sec/step) I0319 04:47:09.847404 364 learning.py:507] global step 25: loss = 0.3113 (1.526 sec/step) INFO:tensorflow:global step 26: loss = 0.4506 (1.747 sec/step) I0319 04:47:11.597443 364 learning.py:507] global step 26: loss = 0.4506 (1.747 sec/step) INFO:tensorflow:global step 27: loss = 0.1345 (1.892 sec/step) I0319 04:47:13.492214 364 learning.py:507] global step 27: loss = 0.1345 (1.892 sec/step) INFO:tensorflow:global step 28: loss = 0.0874 (1.701 sec/step) I0319 04:47:15.202677 364 learning.py:507] global step 28: loss = 0.0874 (1.701 sec/step) INFO:tensorflow:global step 29: loss = 0.1753 (1.277 sec/step) I0319 04:47:16.486171 364 learning.py:507] global step 29: loss = 0.1753 (1.277 sec/step) INFO:tensorflow:global step 30: loss = 0.1359 (1.136 sec/step) I0319 04:47:17.629456 364 learning.py:507] global step 30: loss = 0.1359 (1.136 sec/step) INFO:tensorflow:global step 31: loss = 0.2238 (1.847 sec/step) I0319 04:47:19.479212 364 learning.py:507] global step 31: loss = 0.2238 (1.847 sec/step) INFO:tensorflow:global step 32: loss = 0.1306 (1.317 sec/step) I0319 04:47:20.800726 364 learning.py:507] global step 32: loss = 0.1306 (1.317 sec/step) INFO:tensorflow:global step 33: loss = 0.5274 (1.406 sec/step) I0319 04:47:22.209337 364 learning.py:507] global step 33: loss = 0.5274 (1.406 sec/step) INFO:tensorflow:global step 34: loss = 0.3701 (1.355 sec/step) I0319 04:47:23.570190 364 learning.py:507] global step 34: loss = 0.3701 (1.355 sec/step) INFO:tensorflow:global step 35: loss = 0.3928 (1.422 sec/step) I0319 04:47:24.996030 364 learning.py:507] global step 35: loss = 0.3928 (1.422 sec/step) INFO:tensorflow:global step 36: loss = 1.0443 (1.764 sec/step) I0319 04:47:26.763999 364 learning.py:507] global step 36: loss = 1.0443 (1.764 sec/step) INFO:tensorflow:global step 37: loss = 0.0807 (1.483 sec/step) I0319 04:47:28.253819 364 learning.py:507] global step 37: loss = 0.0807 (1.483 sec/step) INFO:tensorflow:global step 38: loss = 0.2749 (1.470 sec/step) I0319 04:47:29.726541 364 learning.py:507] global step 38: loss = 0.2749 (1.470 sec/step) INFO:tensorflow:global step 39: loss = 0.7892 (1.563 sec/step) I0319 04:47:31.298150 364 learning.py:507] global step 39: loss = 0.7892 (1.563 sec/step) INFO:tensorflow:global step 40: loss = 0.6703 (1.495 sec/step) I0319 04:47:32.799721 364 learning.py:507] global step 40: loss = 0.6703 (1.495 sec/step) INFO:tensorflow:global step 41: loss = 0.5342 (1.359 sec/step) I0319 04:47:34.165800 364 learning.py:507] global step 41: loss = 0.5342 (1.359 sec/step) INFO:tensorflow:global step 42: loss = 0.1596 (1.445 sec/step) I0319 04:47:35.614602 364 learning.py:507] global step 42: loss = 0.1596 (1.445 sec/step) INFO:tensorflow:global step 43: loss = 0.5970 (1.658 sec/step) I0319 04:47:37.278720 364 learning.py:507] global step 43: loss = 0.5970 (1.658 sec/step) INFO:tensorflow:global step 44: loss = 0.1242 (1.797 sec/step) I0319 04:47:39.079350 364 learning.py:507] global step 44: loss = 0.1242 (1.797 sec/step) INFO:tensorflow:global step 45: loss = 0.1456 (1.514 sec/step) I0319 04:47:40.595895 364 learning.py:507] global step 45: loss = 0.1456 (1.514 sec/step) INFO:tensorflow:global step 46: loss = 0.4119 (1.798 sec/step) I0319 04:47:42.407701 364 learning.py:507] global step 46: loss = 0.4119 (1.798 sec/step) INFO:tensorflow:global step 47: loss = 0.1678 (1.447 sec/step) I0319 04:47:43.859330 364 learning.py:507] global step 47: loss = 0.1678 (1.447 sec/step) INFO:tensorflow:global step 48: loss = 0.1030 (1.408 sec/step) I0319 04:47:45.268949 364 learning.py:507] global step 48: loss = 0.1030 (1.408 sec/step) INFO:tensorflow:global step 49: loss = 0.1644 (2.066 sec/step) I0319 04:47:47.335975 364 learning.py:507] global step 49: loss = 0.1644 (2.066 sec/step) INFO:tensorflow:global step 50: loss = 0.1719 (1.448 sec/step) I0319 04:47:48.784025 364 learning.py:507] global step 50: loss = 0.1719 (1.448 sec/step) INFO:tensorflow:global step 51: loss = 0.2133 (1.332 sec/step) I0319 04:47:50.119588 364 learning.py:507] global step 51: loss = 0.2133 (1.332 sec/step) INFO:tensorflow:global step 52: loss = 1.0573 (2.026 sec/step) I0319 04:47:52.148041 364 learning.py:507] global step 52: loss = 1.0573 (2.026 sec/step) INFO:tensorflow:global step 53: loss = 1.2564 (1.819 sec/step) I0319 04:47:53.970621 364 learning.py:507] global step 53: loss = 1.2564 (1.819 sec/step) INFO:tensorflow:global step 54: loss = 0.0982 (1.627 sec/step) I0319 04:47:55.604393 364 learning.py:507] global step 54: loss = 0.0982 (1.627 sec/step) INFO:tensorflow:global step 55: loss = 0.0674 (1.750 sec/step) I0319 04:47:57.361774 364 learning.py:507] global step 55: loss = 0.0674 (1.750 sec/step) INFO:tensorflow:global step 56: loss = 0.3438 (1.190 sec/step) I0319 04:47:58.554425 364 learning.py:507] global step 56: loss = 0.3438 (1.190 sec/step) INFO:tensorflow:global step 57: loss = 0.2610 (1.431 sec/step) I0319 04:47:59.995890 364 learning.py:507] global step 57: loss = 0.2610 (1.431 sec/step) INFO:tensorflow:global step 58: loss = 1.0766 (1.746 sec/step) I0319 04:48:01.745375 364 learning.py:507] global step 58: loss = 1.0766 (1.746 sec/step) INFO:tensorflow:global step 59: loss = 0.1328 (1.408 sec/step) I0319 04:48:03.158226 364 learning.py:507] global step 59: loss = 0.1328 (1.408 sec/step) INFO:tensorflow:global step 60: loss = 0.1345 (1.338 sec/step) I0319 04:48:04.501183 364 learning.py:507] global step 60: loss = 0.1345 (1.338 sec/step) INFO:tensorflow:global step 61: loss = 0.1242 (1.655 sec/step) I0319 04:48:06.159594 364 learning.py:507] global step 61: loss = 0.1242 (1.655 sec/step) INFO:tensorflow:global step 62: loss = 0.1608 (1.572 sec/step) I0319 04:48:07.740104 364 learning.py:507] global step 62: loss = 0.1608 (1.572 sec/step) INFO:tensorflow:global step 63: loss = 0.9657 (1.758 sec/step) I0319 04:48:09.501745 364 learning.py:507] global step 63: loss = 0.9657 (1.758 sec/step) INFO:tensorflow:global step 64: loss = 0.3787 (1.778 sec/step) I0319 04:48:11.290621 364 learning.py:507] global step 64: loss = 0.3787 (1.778 sec/step) INFO:tensorflow:global step 65: loss = 0.4565 (1.374 sec/step) I0319 04:48:12.667491 364 learning.py:507] global step 65: loss = 0.4565 (1.374 sec/step) INFO:tensorflow:global step 66: loss = 0.6435 (1.798 sec/step) I0319 04:48:14.474299 364 learning.py:507] global step 66: loss = 0.6435 (1.798 sec/step) INFO:tensorflow:global step 67: loss = 1.7682 (1.585 sec/step) I0319 04:48:16.063312 364 learning.py:507] global step 67: loss = 1.7682 (1.585 sec/step) INFO:tensorflow:Recording summary at step 67. I0319 04:48:16.181192 11952 supervisor.py:1050] Recording summary at step 67. INFO:tensorflow:global_step/sec: 0.582145 I0319 04:48:16.375717 11640 supervisor.py:1099] global_step/sec: 0.582145 INFO:tensorflow:global step 68: loss = 0.1300 (1.981 sec/step) I0319 04:48:18.049896 364 learning.py:507] global step 68: loss = 0.1300 (1.981 sec/step) INFO:tensorflow:global step 69: loss = 0.4199 (1.570 sec/step) I0319 04:48:19.628312 364 learning.py:507] global step 69: loss = 0.4199 (1.570 sec/step) INFO:tensorflow:global step 70: loss = 0.1031 (1.694 sec/step) I0319 04:48:21.329188 364 learning.py:507] global step 70: loss = 0.1031 (1.694 sec/step) INFO:tensorflow:global step 71: loss = 1.3805 (1.355 sec/step) I0319 04:48:22.687957 364 learning.py:507] global step 71: loss = 1.3805 (1.355 sec/step) INFO:tensorflow:global step 72: loss = 0.1438 (1.395 sec/step) I0319 04:48:24.087367 364 learning.py:507] global step 72: loss = 0.1438 (1.395 sec/step) INFO:tensorflow:global step 73: loss = 0.2211 (1.374 sec/step) I0319 04:48:25.463164 364 learning.py:507] global step 73: loss = 0.2211 (1.374 sec/step) INFO:tensorflow:global step 74: loss = 0.8396 (1.518 sec/step) I0319 04:48:26.987072 364 learning.py:507] global step 74: loss = 0.8396 (1.518 sec/step) INFO:tensorflow:global step 75: loss = 0.2031 (1.840 sec/step) I0319 04:48:28.834165 364 learning.py:507] global step 75: loss = 0.2031 (1.840 sec/step) INFO:tensorflow:global step 76: loss = 1.9371 (1.328 sec/step) I0319 04:48:30.168720 364 learning.py:507] global step 76: loss = 1.9371 (1.328 sec/step) INFO:tensorflow:global step 77: loss = 0.3486 (1.837 sec/step) I0319 04:48:32.009308 364 learning.py:507] global step 77: loss = 0.3486 (1.837 sec/step) INFO:tensorflow:global step 78: loss = 0.1039 (1.184 sec/step) I0319 04:48:33.198170 364 learning.py:507] global step 78: loss = 0.1039 (1.184 sec/step) INFO:tensorflow:global step 79: loss = 0.2413 (1.513 sec/step) I0319 04:48:34.718282 364 learning.py:507] global step 79: loss = 0.2413 (1.513 sec/step) INFO:tensorflow:global step 80: loss = 0.1429 (1.880 sec/step) I0319 04:48:36.604979 364 learning.py:507] global step 80: loss = 0.1429 (1.880 sec/step) INFO:tensorflow:global step 81: loss = 0.0951 (1.406 sec/step) I0319 04:48:38.013414 364 learning.py:507] global step 81: loss = 0.0951 (1.406 sec/step) INFO:tensorflow:global step 82: loss = 0.8337 (1.643 sec/step) I0319 04:48:39.658675 364 learning.py:507] global step 82: loss = 0.8337 (1.643 sec/step) INFO:tensorflow:global step 83: loss = 0.5040 (1.594 sec/step) I0319 04:48:41.265329 364 learning.py:507] global step 83: loss = 0.5040 (1.594 sec/step) INFO:tensorflow:global step 84: loss = 0.1168 (1.314 sec/step) I0319 04:48:42.584311 364 learning.py:507] global step 84: loss = 0.1168 (1.314 sec/step) INFO:tensorflow:global step 85: loss = 0.1672 (1.686 sec/step) I0319 04:48:44.272273 364 learning.py:507] global step 85: loss = 0.1672 (1.686 sec/step) INFO:tensorflow:global step 86: loss = 0.2544 (1.700 sec/step) I0319 04:48:45.981801 364 learning.py:507] global step 86: loss = 0.2544 (1.700 sec/step) INFO:tensorflow:global step 87: loss = 0.1220 (1.413 sec/step) I0319 04:48:47.398018 364 learning.py:507] global step 87: loss = 0.1220 (1.413 sec/step) INFO:tensorflow:global step 88: loss = 0.5824 (1.517 sec/step) I0319 04:48:48.919889 364 learning.py:507] global step 88: loss = 0.5824 (1.517 sec/step) INFO:tensorflow:global step 89: loss = 0.2970 (1.647 sec/step) I0319 04:48:50.573053 364 learning.py:507] global step 89: loss = 0.2970 (1.647 sec/step) INFO:tensorflow:global step 90: loss = 0.1710 (2.105 sec/step) I0319 04:48:52.683998 364 learning.py:507] global step 90: loss = 0.1710 (2.105 sec/step) INFO:tensorflow:global step 91: loss = 0.8682 (1.463 sec/step) I0319 04:48:54.153675 364 learning.py:507] global step 91: loss = 0.8682 (1.463 sec/step) INFO:tensorflow:global step 92: loss = 0.7246 (1.367 sec/step) I0319 04:48:55.523649 364 learning.py:507] global step 92: loss = 0.7246 (1.367 sec/step) INFO:tensorflow:global step 93: loss = 0.2171 (1.471 sec/step) I0319 04:48:56.999266 364 learning.py:507] global step 93: loss = 0.2171 (1.471 sec/step) INFO:tensorflow:global step 94: loss = 1.7167 (1.517 sec/step) I0319 04:48:58.523787 364 learning.py:507] global step 94: loss = 1.7167 (1.517 sec/step) INFO:tensorflow:global step 95: loss = 0.4227 (1.430 sec/step) I0319 04:48:59.959464 364 learning.py:507] global step 95: loss = 0.4227 (1.430 sec/step) INFO:tensorflow:global step 96: loss = 0.1063 (1.750 sec/step) I0319 04:49:01.714869 364 learning.py:507] global step 96: loss = 0.1063 (1.750 sec/step) INFO:tensorflow:global step 97: loss = 0.9854 (1.248 sec/step) I0319 04:49:02.967176 364 learning.py:507] global step 97: loss = 0.9854 (1.248 sec/step) INFO:tensorflow:global step 98: loss = 0.1870 (1.485 sec/step) I0319 04:49:04.458848 364 learning.py:507] global step 98: loss = 0.1870 (1.485 sec/step) INFO:tensorflow:global step 99: loss = 0.3212 (1.383 sec/step) I0319 04:49:05.844509 364 learning.py:507] global step 99: loss = 0.3212 (1.383 sec/step) INFO:tensorflow:global step 100: loss = 0.5613 (1.226 sec/step) I0319 04:49:07.074422 364 learning.py:507] global step 100: loss = 0.5613 (1.226 sec/step) INFO:tensorflow:global step 101: loss = 0.2529 (1.836 sec/step) I0319 04:49:08.916241 364 learning.py:507] global step 101: loss = 0.2529 (1.836 sec/step) INFO:tensorflow:global step 102: loss = 0.1037 (1.282 sec/step) I0319 04:49:10.202330 364 learning.py:507] global step 102: loss = 0.1037 (1.282 sec/step) INFO:tensorflow:global step 103: loss = 1.1943 (1.444 sec/step) I0319 04:49:11.653711 364 learning.py:507] global step 103: loss = 1.1943 (1.444 sec/step) INFO:tensorflow:global step 104: loss = 0.1676 (1.520 sec/step) I0319 04:49:13.180531 364 learning.py:507] global step 104: loss = 0.1676 (1.520 sec/step) INFO:tensorflow:global step 105: loss = 0.1670 (1.619 sec/step) I0319 04:49:14.802405 364 learning.py:507] global step 105: loss = 0.1670 (1.619 sec/step) INFO:tensorflow:global step 106: loss = 0.1771 (1.217 sec/step) I0319 04:49:16.024533 364 learning.py:507] global step 106: loss = 0.1771 (1.217 sec/step) INFO:tensorflow:global step 107: loss = 1.2010 (1.271 sec/step) I0319 04:49:17.301757 364 learning.py:507] global step 107: loss = 1.2010 (1.271 sec/step) INFO:tensorflow:global step 108: loss = 1.7112 (1.464 sec/step) I0319 04:49:18.770067 364 learning.py:507] global step 108: loss = 1.7112 (1.464 sec/step) INFO:tensorflow:global step 109: loss = 0.2795 (1.273 sec/step) I0319 04:49:20.051334 364 learning.py:507] global step 109: loss = 0.2795 (1.273 sec/step) INFO:tensorflow:global step 110: loss = 0.1125 (1.641 sec/step) I0319 04:49:21.695439 364 learning.py:507] global step 110: loss = 0.1125 (1.641 sec/step) INFO:tensorflow:global step 111: loss = 1.3260 (1.638 sec/step) I0319 04:49:23.341597 364 learning.py:507] global step 111: loss = 1.3260 (1.638 sec/step) INFO:tensorflow:global step 112: loss = 0.2368 (1.568 sec/step) I0319 04:49:24.911742 364 learning.py:507] global step 112: loss = 0.2368 (1.568 sec/step) INFO:tensorflow:global step 113: loss = 0.1525 (1.784 sec/step) I0319 04:49:26.705335 364 learning.py:507] global step 113: loss = 0.1525 (1.784 sec/step) INFO:tensorflow:global step 114: loss = 0.1179 (1.816 sec/step) I0319 04:49:28.526045 364 learning.py:507] global step 114: loss = 0.1179 (1.816 sec/step) INFO:tensorflow:global step 115: loss = 0.6230 (1.355 sec/step) I0319 04:49:29.882912 364 learning.py:507] global step 115: loss = 0.6230 (1.355 sec/step) INFO:tensorflow:global step 116: loss = 0.3105 (1.441 sec/step) I0319 04:49:31.332978 364 learning.py:507] global step 116: loss = 0.3105 (1.441 sec/step) INFO:tensorflow:global step 117: loss = 0.7709 (1.772 sec/step) I0319 04:49:33.107395 364 learning.py:507] global step 117: loss = 0.7709 (1.772 sec/step) INFO:tensorflow:global step 118: loss = 0.0949 (1.315 sec/step) I0319 04:49:34.425478 364 learning.py:507] global step 118: loss = 0.0949 (1.315 sec/step) INFO:tensorflow:global step 119: loss = 0.1065 (1.579 sec/step) I0319 04:49:36.009171 364 learning.py:507] global step 119: loss = 0.1065 (1.579 sec/step) INFO:tensorflow:global step 120: loss = 0.6916 (2.022 sec/step) I0319 04:49:38.034049 364 learning.py:507] global step 120: loss = 0.6916 (2.022 sec/step) INFO:tensorflow:global step 121: loss = 0.2065 (1.310 sec/step) I0319 04:49:39.349303 364 learning.py:507] global step 121: loss = 0.2065 (1.310 sec/step) INFO:tensorflow:global step 122: loss = 0.5749 (1.410 sec/step) I0319 04:49:40.771398 364 learning.py:507] global step 122: loss = 0.5749 (1.410 sec/step) INFO:tensorflow:global step 123: loss = 0.1705 (1.391 sec/step) I0319 04:49:42.169762 364 learning.py:507] global step 123: loss = 0.1705 (1.391 sec/step) INFO:tensorflow:global step 124: loss = 0.7633 (1.651 sec/step) I0319 04:49:43.824331 364 learning.py:507] global step 124: loss = 0.7633 (1.651 sec/step) INFO:tensorflow:global step 125: loss = 0.1552 (1.836 sec/step) I0319 04:49:45.664257 364 learning.py:507] global step 125: loss = 0.1552 (1.836 sec/step) INFO:tensorflow:global step 126: loss = 0.2800 (1.208 sec/step) I0319 04:49:46.880459 364 learning.py:507] global step 126: loss = 0.2800 (1.208 sec/step) INFO:tensorflow:global step 127: loss = 1.0588 (1.186 sec/step) I0319 04:49:48.070831 364 learning.py:507] global step 127: loss = 1.0588 (1.186 sec/step) INFO:tensorflow:global step 128: loss = 0.7174 (1.342 sec/step) I0319 04:49:49.420438 364 learning.py:507] global step 128: loss = 0.7174 (1.342 sec/step) INFO:tensorflow:global step 129: loss = 0.4033 (1.645 sec/step) I0319 04:49:51.069907 364 learning.py:507] global step 129: loss = 0.4033 (1.645 sec/step) INFO:tensorflow:global step 130: loss = 0.3166 (1.730 sec/step) I0319 04:49:52.805509 364 learning.py:507] global step 130: loss = 0.3166 (1.730 sec/step) INFO:tensorflow:global step 131: loss = 0.5042 (1.666 sec/step) I0319 04:49:54.479292 364 learning.py:507] global step 131: loss = 0.5042 (1.666 sec/step) INFO:tensorflow:global step 132: loss = 0.8812 (1.624 sec/step) I0319 04:49:56.109142 364 learning.py:507] global step 132: loss = 0.8812 (1.624 sec/step) INFO:tensorflow:global step 133: loss = 0.4504 (1.302 sec/step) I0319 04:49:57.417033 364 learning.py:507] global step 133: loss = 0.4504 (1.302 sec/step) INFO:tensorflow:global step 134: loss = 0.1771 (1.563 sec/step) I0319 04:49:58.984179 364 learning.py:507] global step 134: loss = 0.1771 (1.563 sec/step) INFO:tensorflow:global step 135: loss = 0.2178 (1.499 sec/step) I0319 04:50:00.490538 364 learning.py:507] global step 135: loss = 0.2178 (1.499 sec/step) INFO:tensorflow:global step 136: loss = 0.5225 (1.313 sec/step) I0319 04:50:01.805390 364 learning.py:507] global step 136: loss = 0.5225 (1.313 sec/step) INFO:tensorflow:global step 137: loss = 0.2554 (1.567 sec/step) I0319 04:50:03.381046 364 learning.py:507] global step 137: loss = 0.2554 (1.567 sec/step) INFO:tensorflow:global step 138: loss = 0.6777 (1.419 sec/step) I0319 04:50:04.804274 364 learning.py:507] global step 138: loss = 0.6777 (1.419 sec/step) INFO:tensorflow:global step 139: loss = 0.0796 (1.375 sec/step) I0319 04:50:06.182176 364 learning.py:507] global step 139: loss = 0.0796 (1.375 sec/step) INFO:tensorflow:global step 140: loss = 0.1911 (1.826 sec/step) I0319 04:50:08.016124 364 learning.py:507] global step 140: loss = 0.1911 (1.826 sec/step) INFO:tensorflow:global step 141: loss = 0.9512 (1.519 sec/step) I0319 04:50:09.539597 364 learning.py:507] global step 141: loss = 0.9512 (1.519 sec/step) INFO:tensorflow:global step 142: loss = 0.0634 (1.409 sec/step) I0319 04:50:10.952246 364 learning.py:507] global step 142: loss = 0.0634 (1.409 sec/step) INFO:tensorflow:global step 143: loss = 0.1082 (1.540 sec/step) I0319 04:50:12.497362 364 learning.py:507] global step 143: loss = 0.1082 (1.540 sec/step) INFO:tensorflow:global step 144: loss = 0.2892 (1.753 sec/step) I0319 04:50:14.254212 364 learning.py:507] global step 144: loss = 0.2892 (1.753 sec/step) INFO:tensorflow:global step 145: loss = 0.5855 (1.430 sec/step) I0319 04:50:15.793596 364 learning.py:507] global step 145: loss = 0.5855 (1.430 sec/step) INFO:tensorflow:Recording summary at step 145. I0319 04:50:15.964481 11952 supervisor.py:1050] Recording summary at step 145. INFO:tensorflow:global_step/sec: 0.650136 I0319 04:50:16.350556 11640 supervisor.py:1099] global_step/sec: 0.650136 INFO:tensorflow:global step 146: loss = 0.4862 (1.740 sec/step) I0319 04:50:17.539420 364 learning.py:507] global step 146: loss = 0.4862 (1.740 sec/step) INFO:tensorflow:global step 147: loss = 0.3634 (1.390 sec/step) I0319 04:50:18.933330 364 learning.py:507] global step 147: loss = 0.3634 (1.390 sec/step) INFO:tensorflow:global step 148: loss = 0.2478 (1.450 sec/step) I0319 04:50:20.388875 364 learning.py:507] global step 148: loss = 0.2478 (1.450 sec/step) INFO:tensorflow:global step 149: loss = 1.2744 (1.714 sec/step) I0319 04:50:22.112293 364 learning.py:507] global step 149: loss = 1.2744 (1.714 sec/step) INFO:tensorflow:global step 150: loss = 0.5947 (1.778 sec/step) I0319 04:50:23.897045 364 learning.py:507] global step 150: loss = 0.5947 (1.778 sec/step) INFO:tensorflow:global step 151: loss = 0.5481 (1.775 sec/step) I0319 04:50:25.675297 364 learning.py:507] global step 151: loss = 0.5481 (1.775 sec/step) INFO:tensorflow:global step 152: loss = 0.2686 (1.540 sec/step) I0319 04:50:27.219415 364 learning.py:507] global step 152: loss = 0.2686 (1.540 sec/step) INFO:tensorflow:global step 153: loss = 0.2983 (1.396 sec/step) I0319 04:50:28.617254 364 learning.py:507] global step 153: loss = 0.2983 (1.396 sec/step) INFO:tensorflow:global step 154: loss = 0.7500 (1.613 sec/step) I0319 04:50:30.238888 364 learning.py:507] global step 154: loss = 0.7500 (1.613 sec/step) INFO:tensorflow:global step 155: loss = 1.0497 (1.224 sec/step) I0319 04:50:31.473003 364 learning.py:507] global step 155: loss = 1.0497 (1.224 sec/step) INFO:tensorflow:global step 156: loss = 0.2936 (1.870 sec/step) I0319 04:50:33.345707 364 learning.py:507] global step 156: loss = 0.2936 (1.870 sec/step) INFO:tensorflow:global step 157: loss = 0.3268 (1.167 sec/step) I0319 04:50:34.525191 364 learning.py:507] global step 157: loss = 0.3268 (1.167 sec/step) INFO:tensorflow:global step 158: loss = 0.4109 (1.477 sec/step) I0319 04:50:36.005428 364 learning.py:507] global step 158: loss = 0.4109 (1.477 sec/step) INFO:tensorflow:global step 159: loss = 0.0552 (1.682 sec/step) I0319 04:50:37.694907 364 learning.py:507] global step 159: loss = 0.0552 (1.682 sec/step) INFO:tensorflow:global step 160: loss = 0.4382 (1.603 sec/step) I0319 04:50:39.305548 364 learning.py:507] global step 160: loss = 0.4382 (1.603 sec/step) INFO:tensorflow:global step 161: loss = 0.3729 (1.720 sec/step) I0319 04:50:41.030932 364 learning.py:507] global step 161: loss = 0.3729 (1.720 sec/step) INFO:tensorflow:global step 162: loss = 0.2748 (1.578 sec/step) I0319 04:50:42.613272 364 learning.py:507] global step 162: loss = 0.2748 (1.578 sec/step) INFO:tensorflow:global step 163: loss = 0.1240 (1.297 sec/step) I0319 04:50:43.913322 364 learning.py:507] global step 163: loss = 0.1240 (1.297 sec/step) INFO:tensorflow:global step 164: loss = 0.0691 (1.767 sec/step) I0319 04:50:45.685340 364 learning.py:507] global step 164: loss = 0.0691 (1.767 sec/step) INFO:tensorflow:global step 165: loss = 0.3161 (1.554 sec/step) I0319 04:50:47.249149 364 learning.py:507] global step 165: loss = 0.3161 (1.554 sec/step) INFO:tensorflow:global step 166: loss = 0.2669 (1.911 sec/step) I0319 04:50:49.163924 364 learning.py:507] global step 166: loss = 0.2669 (1.911 sec/step) INFO:tensorflow:global step 167: loss = 0.1074 (1.720 sec/step) I0319 04:50:50.890561 364 learning.py:507] global step 167: loss = 0.1074 (1.720 sec/step) INFO:tensorflow:global step 168: loss = 0.0604 (1.216 sec/step) I0319 04:50:52.110134 364 learning.py:507] global step 168: loss = 0.0604 (1.216 sec/step) INFO:tensorflow:global step 169: loss = 1.0720 (1.967 sec/step) I0319 04:50:54.082913 364 learning.py:507] global step 169: loss = 1.0720 (1.967 sec/step) INFO:tensorflow:global step 170: loss = 0.1853 (1.432 sec/step) I0319 04:50:55.517744 364 learning.py:507] global step 170: loss = 0.1853 (1.432 sec/step) INFO:tensorflow:global step 171: loss = 1.0819 (1.689 sec/step) I0319 04:50:57.218531 364 learning.py:507] global step 171: loss = 1.0819 (1.689 sec/step) INFO:tensorflow:global step 172: loss = 1.5981 (1.429 sec/step) I0319 04:50:58.651670 364 learning.py:507] global step 172: loss = 1.5981 (1.429 sec/step) INFO:tensorflow:global step 173: loss = 0.6068 (1.732 sec/step) I0319 04:51:00.388776 364 learning.py:507] global step 173: loss = 0.6068 (1.732 sec/step) INFO:tensorflow:global step 174: loss = 0.3324 (1.626 sec/step) I0319 04:51:02.018367 364 learning.py:507] global step 174: loss = 0.3324 (1.626 sec/step) INFO:tensorflow:global step 175: loss = 0.4822 (1.615 sec/step) I0319 04:51:03.639944 364 learning.py:507] global step 175: loss = 0.4822 (1.615 sec/step) INFO:tensorflow:global step 176: loss = 0.0935 (1.548 sec/step) I0319 04:51:05.190495 364 learning.py:507] global step 176: loss = 0.0935 (1.548 sec/step) INFO:tensorflow:global step 177: loss = 0.7363 (1.930 sec/step) I0319 04:51:07.126455 364 learning.py:507] global step 177: loss = 0.7363 (1.930 sec/step) INFO:tensorflow:global step 178: loss = 0.6893 (1.682 sec/step) I0319 04:51:08.812160 364 learning.py:507] global step 178: loss = 0.6893 (1.682 sec/step) INFO:tensorflow:global step 179: loss = 0.2395 (1.469 sec/step) I0319 04:51:10.285775 364 learning.py:507] global step 179: loss = 0.2395 (1.469 sec/step) INFO:tensorflow:global step 180: loss = 0.1028 (1.702 sec/step) I0319 04:51:11.990784 364 learning.py:507] global step 180: loss = 0.1028 (1.702 sec/step) INFO:tensorflow:global step 181: loss = 0.2560 (1.460 sec/step) I0319 04:51:13.455863 364 learning.py:507] global step 181: loss = 0.2560 (1.460 sec/step) INFO:tensorflow:global step 182: loss = 0.9754 (1.594 sec/step) I0319 04:51:15.057117 364 learning.py:507] global step 182: loss = 0.9754 (1.594 sec/step) INFO:tensorflow:global step 183: loss = 0.3302 (1.824 sec/step) I0319 04:51:16.885294 364 learning.py:507] global step 183: loss = 0.3302 (1.824 sec/step) INFO:tensorflow:global step 184: loss = 1.1578 (1.191 sec/step) I0319 04:51:18.080430 364 learning.py:507] global step 184: loss = 1.1578 (1.191 sec/step) INFO:tensorflow:global step 185: loss = 0.8012 (1.685 sec/step) I0319 04:51:19.769748 364 learning.py:507] global step 185: loss = 0.8012 (1.685 sec/step) INFO:tensorflow:global step 186: loss = 0.9599 (1.484 sec/step) I0319 04:51:21.257471 364 learning.py:507] global step 186: loss = 0.9599 (1.484 sec/step) INFO:tensorflow:global step 187: loss = 0.9209 (1.217 sec/step) I0319 04:51:22.481050 364 learning.py:507] global step 187: loss = 0.9209 (1.217 sec/step) INFO:tensorflow:global step 188: loss = 0.5209 (1.625 sec/step) I0319 04:51:24.109889 364 learning.py:507] global step 188: loss = 0.5209 (1.625 sec/step) INFO:tensorflow:global step 189: loss = 0.4784 (1.445 sec/step) I0319 04:51:25.558565 364 learning.py:507] global step 189: loss = 0.4784 (1.445 sec/step) INFO:tensorflow:global step 190: loss = 0.6963 (1.654 sec/step) I0319 04:51:27.219830 364 learning.py:507] global step 190: loss = 0.6963 (1.654 sec/step) INFO:tensorflow:global step 191: loss = 0.6120 (1.709 sec/step) I0319 04:51:28.938128 364 learning.py:507] global step 191: loss = 0.6120 (1.709 sec/step) INFO:tensorflow:global step 192: loss = 0.3785 (1.800 sec/step) I0319 04:51:30.740936 364 learning.py:507] global step 192: loss = 0.3785 (1.800 sec/step) INFO:tensorflow:global step 193: loss = 0.4431 (1.768 sec/step) I0319 04:51:32.516358 364 learning.py:507] global step 193: loss = 0.4431 (1.768 sec/step) INFO:tensorflow:global step 194: loss = 0.7243 (1.538 sec/step) I0319 04:51:34.058236 364 learning.py:507] global step 194: loss = 0.7243 (1.538 sec/step) INFO:tensorflow:global step 195: loss = 1.4300 (1.871 sec/step) I0319 04:51:35.936743 364 learning.py:507] global step 195: loss = 1.4300 (1.871 sec/step) INFO:tensorflow:global step 196: loss = 0.3978 (1.475 sec/step) I0319 04:51:37.421163 364 learning.py:507] global step 196: loss = 0.3978 (1.475 sec/step) INFO:tensorflow:global step 197: loss = 0.5714 (1.378 sec/step) I0319 04:51:38.806543 364 learning.py:507] global step 197: loss = 0.5714 (1.378 sec/step) INFO:tensorflow:global step 198: loss = 0.7784 (1.643 sec/step) I0319 04:51:40.452777 364 learning.py:507] global step 198: loss = 0.7784 (1.643 sec/step) INFO:tensorflow:global step 199: loss = 0.6074 (1.606 sec/step) I0319 04:51:42.061750 364 learning.py:507] global step 199: loss = 0.6074 (1.606 sec/step) INFO:tensorflow:global step 200: loss = 0.2778 (1.553 sec/step) I0319 04:51:43.622875 364 learning.py:507] global step 200: loss = 0.2778 (1.553 sec/step) INFO:tensorflow:global step 201: loss = 0.3131 (1.138 sec/step) I0319 04:51:44.764246 364 learning.py:507] global step 201: loss = 0.3131 (1.138 sec/step) INFO:tensorflow:global step 202: loss = 0.6853 (1.557 sec/step) I0319 04:51:46.329874 364 learning.py:507] global step 202: loss = 0.6853 (1.557 sec/step) INFO:tensorflow:global step 203: loss = 0.6157 (1.423 sec/step) I0319 04:51:47.757684 364 learning.py:507] global step 203: loss = 0.6157 (1.423 sec/step) INFO:tensorflow:global step 204: loss = 0.4020 (1.525 sec/step) I0319 04:51:49.287344 364 learning.py:507] global step 204: loss = 0.4020 (1.525 sec/step) INFO:tensorflow:global step 205: loss = 1.1128 (1.526 sec/step) I0319 04:51:50.816547 364 learning.py:507] global step 205: loss = 1.1128 (1.526 sec/step) INFO:tensorflow:global step 206: loss = 0.8958 (1.750 sec/step) I0319 04:51:52.571751 364 learning.py:507] global step 206: loss = 0.8958 (1.750 sec/step) INFO:tensorflow:global step 207: loss = 0.6357 (1.933 sec/step) I0319 04:51:54.511366 364 learning.py:507] global step 207: loss = 0.6357 (1.933 sec/step) INFO:tensorflow:global step 208: loss = 0.7849 (1.457 sec/step) I0319 04:51:55.971696 364 learning.py:507] global step 208: loss = 0.7849 (1.457 sec/step) INFO:tensorflow:global step 209: loss = 0.3298 (1.471 sec/step) I0319 04:51:57.445734 364 learning.py:507] global step 209: loss = 0.3298 (1.471 sec/step) INFO:tensorflow:global step 210: loss = 0.5548 (1.602 sec/step) I0319 04:51:59.051063 364 learning.py:507] global step 210: loss = 0.5548 (1.602 sec/step) INFO:tensorflow:global step 211: loss = 0.5362 (1.554 sec/step) I0319 04:52:00.611656 364 learning.py:507] global step 211: loss = 0.5362 (1.554 sec/step) INFO:tensorflow:global step 212: loss = 1.0272 (1.510 sec/step) I0319 04:52:02.126260 364 learning.py:507] global step 212: loss = 1.0272 (1.510 sec/step) INFO:tensorflow:global step 213: loss = 1.2521 (1.733 sec/step) I0319 04:52:03.864163 364 learning.py:507] global step 213: loss = 1.2521 (1.733 sec/step) INFO:tensorflow:global step 214: loss = 0.6857 (1.497 sec/step) I0319 04:52:05.365969 364 learning.py:507] global step 214: loss = 0.6857 (1.497 sec/step) INFO:tensorflow:global step 215: loss = 0.7510 (1.363 sec/step) I0319 04:52:06.732864 364 learning.py:507] global step 215: loss = 0.7510 (1.363 sec/step) INFO:tensorflow:global step 216: loss = 0.4134 (1.559 sec/step) I0319 04:52:08.294779 364 learning.py:507] global step 216: loss = 0.4134 (1.559 sec/step) INFO:tensorflow:global step 217: loss = 1.0034 (1.628 sec/step) I0319 04:52:09.929885 364 learning.py:507] global step 217: loss = 1.0034 (1.628 sec/step) INFO:tensorflow:global step 218: loss = 0.0565 (1.398 sec/step) I0319 04:52:11.330737 364 learning.py:507] global step 218: loss = 0.0565 (1.398 sec/step) INFO:tensorflow:global step 219: loss = 0.9659 (1.846 sec/step) I0319 04:52:13.185419 364 learning.py:507] global step 219: loss = 0.9659 (1.846 sec/step) INFO:tensorflow:global step 220: loss = 0.3381 (1.624 sec/step) I0319 04:52:14.816992 364 learning.py:507] global step 220: loss = 0.3381 (1.624 sec/step) INFO:tensorflow:global_step/sec: 0.624989 I0319 04:52:16.352658 11640 supervisor.py:1099] global_step/sec: 0.624989 INFO:tensorflow:Recording summary at step 220. I0319 04:52:16.565918 11952 supervisor.py:1050] Recording summary at step 220. INFO:tensorflow:global step 221: loss = 0.2794 (1.949 sec/step) I0319 04:52:16.785773 364 learning.py:507] global step 221: loss = 0.2794 (1.949 sec/step) INFO:tensorflow:global step 222: loss = 0.1916 (1.655 sec/step) I0319 04:52:18.460483 364 learning.py:507] global step 222: loss = 0.1916 (1.655 sec/step) INFO:tensorflow:global step 223: loss = 0.5311 (1.310 sec/step) I0319 04:52:19.776767 364 learning.py:507] global step 223: loss = 0.5311 (1.310 sec/step) INFO:tensorflow:global step 224: loss = 0.4124 (1.559 sec/step) I0319 04:52:21.339740 364 learning.py:507] global step 224: loss = 0.4124 (1.559 sec/step) INFO:tensorflow:global step 225: loss = 0.4224 (1.193 sec/step) I0319 04:52:22.538455 364 learning.py:507] global step 225: loss = 0.4224 (1.193 sec/step) INFO:tensorflow:global step 226: loss = 0.4496 (1.740 sec/step) I0319 04:52:24.283688 364 learning.py:507] global step 226: loss = 0.4496 (1.740 sec/step) INFO:tensorflow:global step 227: loss = 0.4276 (1.486 sec/step) I0319 04:52:25.773209 364 learning.py:507] global step 227: loss = 0.4276 (1.486 sec/step) INFO:tensorflow:global step 228: loss = 0.7981 (1.447 sec/step) I0319 04:52:27.223412 364 learning.py:507] global step 228: loss = 0.7981 (1.447 sec/step) INFO:tensorflow:global step 229: loss = 0.2132 (1.545 sec/step) I0319 04:52:28.771744 364 learning.py:507] global step 229: loss = 0.2132 (1.545 sec/step) INFO:tensorflow:global step 230: loss = 1.1949 (1.302 sec/step) I0319 04:52:30.076610 364 learning.py:507] global step 230: loss = 1.1949 (1.302 sec/step) INFO:tensorflow:global step 231: loss = 0.8677 (1.128 sec/step) I0319 04:52:31.216661 364 learning.py:507] global step 231: loss = 0.8677 (1.128 sec/step) INFO:tensorflow:global step 232: loss = 0.6817 (1.546 sec/step) I0319 04:52:32.769538 364 learning.py:507] global step 232: loss = 0.6817 (1.546 sec/step) INFO:tensorflow:global step 233: loss = 1.2424 (1.254 sec/step) I0319 04:52:34.028019 364 learning.py:507] global step 233: loss = 1.2424 (1.254 sec/step) INFO:tensorflow:global step 234: loss = 0.3331 (1.887 sec/step) I0319 04:52:35.919743 364 learning.py:507] global step 234: loss = 0.3331 (1.887 sec/step) INFO:tensorflow:global step 235: loss = 0.4883 (1.409 sec/step) I0319 04:52:37.336224 364 learning.py:507] global step 235: loss = 0.4883 (1.409 sec/step) INFO:tensorflow:global step 236: loss = 0.4326 (1.685 sec/step) I0319 04:52:39.024921 364 learning.py:507] global step 236: loss = 0.4326 (1.685 sec/step) INFO:tensorflow:global step 237: loss = 0.6115 (1.718 sec/step) I0319 04:52:40.747416 364 learning.py:507] global step 237: loss = 0.6115 (1.718 sec/step) INFO:tensorflow:global step 238: loss = 0.5296 (1.616 sec/step) I0319 04:52:42.371548 364 learning.py:507] global step 238: loss = 0.5296 (1.616 sec/step) INFO:tensorflow:global step 239: loss = 0.9521 (1.377 sec/step) I0319 04:52:43.751464 364 learning.py:507] global step 239: loss = 0.9521 (1.377 sec/step) INFO:tensorflow:global step 240: loss = 0.5883 (1.219 sec/step) I0319 04:52:44.974537 364 learning.py:507] global step 240: loss = 0.5883 (1.219 sec/step) INFO:tensorflow:global step 241: loss = 0.4915 (1.649 sec/step) I0319 04:52:46.630012 364 learning.py:507] global step 241: loss = 0.4915 (1.649 sec/step) INFO:tensorflow:global step 242: loss = 0.6763 (1.437 sec/step) I0319 04:52:48.070969 364 learning.py:507] global step 242: loss = 0.6763 (1.437 sec/step) INFO:tensorflow:global step 243: loss = 0.8012 (1.640 sec/step) I0319 04:52:49.720772 364 learning.py:507] global step 243: loss = 0.8012 (1.640 sec/step) INFO:tensorflow:global step 244: loss = 0.7837 (1.721 sec/step) I0319 04:52:51.445543 364 learning.py:507] global step 244: loss = 0.7837 (1.721 sec/step) INFO:tensorflow:global step 245: loss = 0.3482 (1.278 sec/step) I0319 04:52:52.732091 364 learning.py:507] global step 245: loss = 0.3482 (1.278 sec/step) INFO:tensorflow:global step 246: loss = 0.3787 (1.518 sec/step) I0319 04:52:54.255427 364 learning.py:507] global step 246: loss = 0.3787 (1.518 sec/step) INFO:tensorflow:global step 247: loss = 0.1817 (1.278 sec/step) I0319 04:52:55.539709 364 learning.py:507] global step 247: loss = 0.1817 (1.278 sec/step) INFO:tensorflow:global step 248: loss = 0.3679 (1.761 sec/step) I0319 04:52:57.306697 364 learning.py:507] global step 248: loss = 0.3679 (1.761 sec/step) INFO:tensorflow:global step 249: loss = 0.4228 (1.213 sec/step) I0319 04:52:58.525420 364 learning.py:507] global step 249: loss = 0.4228 (1.213 sec/step) INFO:tensorflow:global step 250: loss = 0.7375 (1.739 sec/step) I0319 04:53:00.271973 364 learning.py:507] global step 250: loss = 0.7375 (1.739 sec/step) INFO:tensorflow:global step 251: loss = 0.3578 (1.292 sec/step) I0319 04:53:01.568566 364 learning.py:507] global step 251: loss = 0.3578 (1.292 sec/step) INFO:tensorflow:global step 252: loss = 0.1299 (1.626 sec/step) I0319 04:53:03.199404 364 learning.py:507] global step 252: loss = 0.1299 (1.626 sec/step) INFO:tensorflow:global step 253: loss = 0.5180 (1.683 sec/step) I0319 04:53:04.885834 364 learning.py:507] global step 253: loss = 0.5180 (1.683 sec/step) INFO:tensorflow:global step 254: loss = 0.3770 (1.754 sec/step) I0319 04:53:06.645716 364 learning.py:507] global step 254: loss = 0.3770 (1.754 sec/step) INFO:tensorflow:global step 255: loss = 1.2757 (1.377 sec/step) I0319 04:53:08.030099 364 learning.py:507] global step 255: loss = 1.2757 (1.377 sec/step) INFO:tensorflow:global step 256: loss = 0.2901 (1.551 sec/step) I0319 04:53:09.584757 364 learning.py:507] global step 256: loss = 0.2901 (1.551 sec/step) INFO:tensorflow:global step 257: loss = 0.7688 (1.739 sec/step) I0319 04:53:11.327075 364 learning.py:507] global step 257: loss = 0.7688 (1.739 sec/step) INFO:tensorflow:global step 258: loss = 0.3277 (1.586 sec/step) I0319 04:53:12.919140 364 learning.py:507] global step 258: loss = 0.3277 (1.586 sec/step) INFO:tensorflow:global step 259: loss = 0.6702 (1.759 sec/step) I0319 04:53:14.684121 364 learning.py:507] global step 259: loss = 0.6702 (1.759 sec/step) INFO:tensorflow:global step 260: loss = 0.3411 (1.517 sec/step) I0319 04:53:16.204663 364 learning.py:507] global step 260: loss = 0.3411 (1.517 sec/step) INFO:tensorflow:global step 261: loss = 0.6580 (1.608 sec/step) I0319 04:53:17.822477 364 learning.py:507] global step 261: loss = 0.6580 (1.608 sec/step) INFO:tensorflow:global step 262: loss = 0.3830 (1.440 sec/step) I0319 04:53:19.269164 364 learning.py:507] global step 262: loss = 0.3830 (1.440 sec/step) INFO:tensorflow:global step 263: loss = 0.1305 (1.614 sec/step) I0319 04:53:20.887327 364 learning.py:507] global step 263: loss = 0.1305 (1.614 sec/step) INFO:tensorflow:global step 264: loss = 0.4768 (1.486 sec/step) I0319 04:53:22.376844 364 learning.py:507] global step 264: loss = 0.4768 (1.486 sec/step) INFO:tensorflow:global step 265: loss = 0.3253 (1.766 sec/step) I0319 04:53:24.147161 364 learning.py:507] global step 265: loss = 0.3253 (1.766 sec/step) INFO:tensorflow:global step 266: loss = 0.5892 (1.644 sec/step) I0319 04:53:25.796072 364 learning.py:507] global step 266: loss = 0.5892 (1.644 sec/step) INFO:tensorflow:global step 267: loss = 0.4180 (1.697 sec/step) I0319 04:53:27.497094 364 learning.py:507] global step 267: loss = 0.4180 (1.697 sec/step) INFO:tensorflow:global step 268: loss = 0.6555 (1.521 sec/step) I0319 04:53:29.020992 364 learning.py:507] global step 268: loss = 0.6555 (1.521 sec/step) INFO:tensorflow:global step 269: loss = 0.5218 (1.567 sec/step) I0319 04:53:30.592278 364 learning.py:507] global step 269: loss = 0.5218 (1.567 sec/step) INFO:tensorflow:global step 270: loss = 0.3167 (1.544 sec/step) I0319 04:53:32.143271 364 learning.py:507] global step 270: loss = 0.3167 (1.544 sec/step) INFO:tensorflow:global step 271: loss = 1.0415 (1.505 sec/step) I0319 04:53:33.650626 364 learning.py:507] global step 271: loss = 1.0415 (1.505 sec/step) INFO:tensorflow:global step 272: loss = 0.2386 (1.323 sec/step) I0319 04:53:34.981791 364 learning.py:507] global step 272: loss = 0.2386 (1.323 sec/step) INFO:tensorflow:global step 273: loss = 0.4155 (1.973 sec/step) I0319 04:53:36.959651 364 learning.py:507] global step 273: loss = 0.4155 (1.973 sec/step) INFO:tensorflow:global step 274: loss = 0.5937 (1.394 sec/step) I0319 04:53:38.360134 364 learning.py:507] global step 274: loss = 0.5937 (1.394 sec/step) INFO:tensorflow:global step 275: loss = 0.4529 (1.741 sec/step) I0319 04:53:40.104373 364 learning.py:507] global step 275: loss = 0.4529 (1.741 sec/step) INFO:tensorflow:global step 276: loss = 0.0916 (1.654 sec/step) I0319 04:53:41.762323 364 learning.py:507] global step 276: loss = 0.0916 (1.654 sec/step) INFO:tensorflow:global step 277: loss = 0.5982 (1.401 sec/step) I0319 04:53:43.166906 364 learning.py:507] global step 277: loss = 0.5982 (1.401 sec/step) INFO:tensorflow:global step 278: loss = 0.3841 (1.423 sec/step) I0319 04:53:44.593448 364 learning.py:507] global step 278: loss = 0.3841 (1.423 sec/step) INFO:tensorflow:global step 279: loss = 0.6348 (1.643 sec/step) I0319 04:53:46.239737 364 learning.py:507] global step 279: loss = 0.6348 (1.643 sec/step) INFO:tensorflow:global step 280: loss = 0.6191 (1.391 sec/step) I0319 04:53:47.633089 364 learning.py:507] global step 280: loss = 0.6191 (1.391 sec/step) INFO:tensorflow:global step 281: loss = 0.2874 (1.717 sec/step) I0319 04:53:49.356998 364 learning.py:507] global step 281: loss = 0.2874 (1.717 sec/step) INFO:tensorflow:global step 282: loss = 0.6060 (1.997 sec/step) I0319 04:53:51.357581 364 learning.py:507] global step 282: loss = 0.6060 (1.997 sec/step) INFO:tensorflow:global step 283: loss = 0.1896 (1.764 sec/step) I0319 04:53:53.124932 364 learning.py:507] global step 283: loss = 0.1896 (1.764 sec/step) INFO:tensorflow:global step 284: loss = 0.6543 (1.383 sec/step) I0319 04:53:54.510634 364 learning.py:507] global step 284: loss = 0.6543 (1.383 sec/step) INFO:tensorflow:global step 285: loss = 0.5309 (1.258 sec/step) I0319 04:53:55.771763 364 learning.py:507] global step 285: loss = 0.5309 (1.258 sec/step) INFO:tensorflow:global step 286: loss = 0.4458 (1.497 sec/step) I0319 04:53:57.275016 364 learning.py:507] global step 286: loss = 0.4458 (1.497 sec/step) INFO:tensorflow:global step 287: loss = 0.6489 (1.969 sec/step) I0319 04:53:59.249294 364 learning.py:507] global step 287: loss = 0.6489 (1.969 sec/step) INFO:tensorflow:global step 288: loss = 0.5786 (1.489 sec/step) I0319 04:54:00.745079 364 learning.py:507] global step 288: loss = 0.5786 (1.489 sec/step) INFO:tensorflow:global step 289: loss = 0.2843 (1.301 sec/step) I0319 04:54:02.050796 364 learning.py:507] global step 289: loss = 0.2843 (1.301 sec/step) INFO:tensorflow:global step 290: loss = 0.7533 (1.717 sec/step) I0319 04:54:03.769598 364 learning.py:507] global step 290: loss = 0.7533 (1.717 sec/step) INFO:tensorflow:global step 291: loss = 0.4511 (1.385 sec/step) I0319 04:54:05.162354 364 learning.py:507] global step 291: loss = 0.4511 (1.385 sec/step) INFO:tensorflow:global step 292: loss = 0.7568 (1.537 sec/step) I0319 04:54:06.703061 364 learning.py:507] global step 292: loss = 0.7568 (1.537 sec/step) INFO:tensorflow:global step 293: loss = 0.4055 (1.737 sec/step) I0319 04:54:08.443886 364 learning.py:507] global step 293: loss = 0.4055 (1.737 sec/step) INFO:tensorflow:global step 294: loss = 0.3836 (1.325 sec/step) I0319 04:54:09.773977 364 learning.py:507] global step 294: loss = 0.3836 (1.325 sec/step) INFO:tensorflow:global step 295: loss = 0.1835 (1.649 sec/step) I0319 04:54:11.430313 364 learning.py:507] global step 295: loss = 0.1835 (1.649 sec/step) INFO:tensorflow:global step 296: loss = 0.2459 (1.458 sec/step) I0319 04:54:12.893516 364 learning.py:507] global step 296: loss = 0.2459 (1.458 sec/step) INFO:tensorflow:global step 297: loss = 0.4840 (1.427 sec/step) I0319 04:54:14.324237 364 learning.py:507] global step 297: loss = 0.4840 (1.427 sec/step) INFO:tensorflow:Saving checkpoint to path training/model.ckpt I0319 04:56:14.630711 9996 supervisor.py:1117] Saving checkpoint to path training/model.ckpt
i tried deleting the files and retraining it still stops after a few steps
The problem is due to train & test images. follow 80:20 rule
The problem is due to train & test images. follow 80:20 rule
Like i have to swap test and train images?
The error In my case was because the train and test images have the same count. then I divided images 80:20 Problem was solved.
The problem can also be GPU exhaustion as you are using 940mx
I too faced the same issue, the error was a combination of gpu and ram exhaustion. It got resolved when we upgraded the system to one that had higher configuration. You can monitor them by htop (ram) and nvidia-smi(gpu) commands in terminal (putty in my case) to diagnose this issue