Abstractive-Summarization-With-Transfer-Learning

Abstractive-Summarization-With-Transfer-Learning copied to clipboard

How can I get a abstract quickly, now I need long time and many cpu source to count it, if have a fast solution ?

Tesla-jiang

ValueError during the init of pretrained BERT

4

Hello! I tried your code in a google colab and i encountered a problem i wasn't able to solve. During the inititalization of the Bert encoder in your ipynb: https://github.com/santhoshkolloju/Abstractive-Summarization-With-Transfer-Learning/blob/master/BERT_SUMM.ipynb...

shy1992

Not added position embedding to BERT encoder Input

1

` # Creates segment embeddings for each type of tokens. segment_embedder = tx.modules.WordEmbedder( vocab_size=bert_config.type_vocab_size, hparams=bert_config.segment_embed) segment_embeds = segment_embedder(src_segment_ids) input_embeds = word_embeds + segment_embeds` As per BERT paper, the input embeddings...

ankit011094

Network is not optimised.

1

The network for summarization is not optimised. Therefore the loss is too high and does not reduce much.

ASH1998

How did you get the data txt files ? How did you process it ? Did you tokenize it ?

astariul

decoder embedding

1

@santhoshkolloju when you train this model, do you use bert embedding as abstract embedding, it mean article and abstract will go through bert when train this summary model?

xiongma

@santhoshkolloju Hi, i'm using your code to train on my own data, but i find that the bleu score in your code is multiplied by 100, and I am wondering...

ZhuochengZhang98

keyum

AttributeError: module 'tensorflow.python.layers.layers' has no attribute 'Layer'

1

File "texar_repo\texar\core\layers.py", line 628, in class _ReducePooling1D(tf.layers.Layer): AttributeError: module 'tensorflow.python.layers.layers' has no attribute 'Layer' what should i do ? thanks

dreamfuluser

Thanks, I've made the suggested changes. The process is no longer hanging, but I see the following error. (I haven't made any other code changes)

1

angeluau