XSum icon indicating copy to clipboard operation
XSum copied to clipboard

Just a comment (poor results) ...

Open victoriastuart opened this issue 6 years ago • 8 comments

... very interesting paper (http://aclweb.org/anthology/D18-1206 , with included examples), but I tried the online demo, http://cohort.inf.ed.ac.uk/xsum.html , with rather appalling results.

The textual sources for my tests were the abstract for one of my published papers, and the Google infobox for Nova Scotia.

Does the code for the online demo faithfully replicate the code in the paper?

selection_999 1097

selection_999 1098

victoriastuart avatar Dec 20 '18 22:12 victoriastuart

Thanks for sharing your results. We have also different texts to play with our demo. Note that the demo uses a model which is trained on the XSum (BBC) dataset to generate an extreme summary (single sentence). The underlying model is not faithful to other datasets.

shashiongithub avatar Dec 20 '18 23:12 shashiongithub

Ahh, thank you for the quick reply (appreciated). Would we be able to train on our own datasets, or (even better) use a pretrained language model (e.g.: fastText; ELMo; BERT) ... that would likely include relevant semantic information/embeddings?

victoriastuart avatar Dec 20 '18 23:12 victoriastuart

Of course you can train these models on your own datasets. All the codes are available. It would be interesting to plug pretrained language model (e.g.: fastText; ELMo; BERT) with these architectures.

shashiongithub avatar Dec 21 '18 00:12 shashiongithub

Excellent; thank you! :-)

victoriastuart avatar Dec 21 '18 01:12 victoriastuart

@victoriastuart do you know how to train model use myself data ? and how to combine fasttext or bert to make the result better ? thank you

kedimomo avatar Feb 15 '19 13:02 kedimomo

@shashiongithub how to make this project support Chinese language ? thank

kedimomo avatar Feb 15 '19 17:02 kedimomo

I have not explored these options in my models. I do encourage you to do so.

shashiongithub avatar Feb 16 '19 15:02 shashiongithub

@shashiongithub thank you

kedimomo avatar Feb 18 '19 02:02 kedimomo