hiersumm icon indicating copy to clipboard operation
hiersumm copied to clipboard

how to load spm9998_3.model file?

Open LGDEMO opened this issue 4 years ago • 1 comments

Dear Mr. Liu,

I'm studying your paper “Hierarchical Transformers for Multi-Document Summarization” and code, and I'm a new learner in this task. Recently, I wanna use your code to run my task which language is Chinese. Now, I have a question and need your help. In your code, there is a file named spm9998_3.model, but I do not konw how to load it and the contents in it. Could you tell me how to load this file?

LGDEMO avatar Oct 13 '20 07:10 LGDEMO

Hi, @LGDEMO

In the README file, there is a link to download the vocabulary.

The sentencepiece vocab file is at: https://drive.google.com/open?id=1zbUILFWrgIeLEzSP93Mz5JkdVwVPY9Bf

This is the spm9998_3.model. So you can put the path in the command or set VOCAB_PATH then in command just change to $VOCAB_PATH

emoryr avatar Jan 06 '21 20:01 emoryr