kelvinleen

in file model.py, _build_var_ema create and var_ema, and apply to all trainable variables, but it didn't use average to update the trainable variables. only in graph_handler.py, when load model from...

如何finetune自己的数据

1

能否提供一下超参数的配置文件？ 另外，打包中的bert_config_tiny.json这个文件似乎不是run_finetuning.py的hparam的参数文件

issue about the conv2d operation

2

as in https://github.com/guoyinwang/LEAM/issues/6#issue-347848059, the implementation is not same as what the paper shows in equation 3. i think line50 in model.py should be replaced as follows: G = tf.expand_dims(G, axis=-1)...

def gumbel_softmax(logits, temperature, hard=False): """Sample from the Gumbel-Softmax distribution and optionally discretize. Args: logits: [batch_size, n_class] unnormalized log-probs temperature: non-negative scalar hard: if True, take argmax, but differentiate w.r.t. soft...