sleepfin

Why reshape after bias_add ?

5

Notice codes [HERE](https://github.com/tensorflow/benchmarks/blob/master/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py#L333) ``` biased = tf.reshape( tf.nn.bias_add( conv, biases, data_format=self.data_format), conv.get_shape()) ``` I think the output shape of bias_add is exactly the same as conv.get_shape(). So why bother to...

Poor performance in distributed runing when batch_size is small (synthetic input)

8

### Envs: - Python: 2.7 - TensorFlow: 1.8.0 - CUDA: 9.0 - CuDNN: 7.0 - benchmarks commit id: fc993da280312ab65210e7e80bb6fa7f7489182e - benchmarks commit date: Wed May 16 16:54:07 2018 - CPU:...

I notice some difference between PVAnet_train and PVAnet_test, which makes the Tensor does not match when loading a training ckpt to a test model. PVAnet_train.py -> line 96 ` (self.feed('downsample',...