COCON_ICLR2021

COCON_ICLR2021 copied to clipboard

Really great paper and thanks for open-sourcing the code! Whether this work can be transferred to other languages, such as Chinese？

janleemark

'cocon_block' has no attribute 'cocon_attn'

2

We meet a problem like this: Traceback (most recent call last): File "traininfer_cocon.py", line 2980, in main() File "traininfer_cocon.py", line 2783, in main global_step, tr_loss = train_cocon(args, train_dataset, model, tokenizer,...

wying8349

First of all, thank you for your work and code. For the part of using classifier evaluation to generate text categories, you pointed out in the appendix that you used“...

zh57398

I meet on this problem: from .modeling_tf_utils import TFPreTrainedModel, get_initializer, keras_serializable, shape_list ImportError: cannot import name 'keras_serializable' The version of huggingface/transformers in my env is 2.10.0.

HunYuanfeng

Hi. I'm sorry to bother you right now. I am a student now, and I am using cocon, but I met some difficulties in the training process. When I trained...

921418569

There are many versions of BLEU-4 scripts yielding different results for the same input. Unfortunately, I could not pin down the right script to calculate the BLEU-4 score in this...

araloak