pren1

Tutorial: A Pipeline Of Pretraining Bert On Google TPU

11

For anyone who wants to tune the pre-trained model offered by Google on your own domain-specific corpus for several additional epochs using Google TPU, here is a tutorial I just...

Hello, thank you for your code! It's quite useful. I just reimplement your code in Keras, at here: https://github.com/pren1/keras-MMD-Variational-Autoencoder.git I hope someone will find this link useful.

Please change this part: ``` train_mean_op = tf.assign(pop_mean, pop_mean * decay + batch_mean * (1 - decay)) train_var_op = tf.assign(pop_var, pop_var * decay + batch_var * (1 - decay)) def...

Update for tensorflow 1.12.0

2

Just some version problems, and I believe you can also find solutions easily by yourself :D changes: ``` scalar_summary should be renamed to tf.summary.scalar tf.histogram_summary should be renamed to tf.summary.histogram...