pointer-generator icon indicating copy to clipboard operation
pointer-generator copied to clipboard
verified publisher icon abisee

Training Step

Open ghost opened this issue 8 years ago • 2 comments

Hi,

is there a maximum training step setting? For example, I want the maximum training step to be 10k. It will stop after that.

Thanks.

ghost avatar Jun 03 '17 17:06 ghost

How many training steps and vocab size does it need to generate meaningful summary? Just for a test, I used 20K vocab extracted from ~2M Yelp reviews and 1k training. I got: INFO:tensorflow:REFERENCE SUMMARY: Go for the spicy asian soup of the day My favorite quick meal INFO:tensorflow:GENERATED SUMMARY: a a a a a

It's not related to the text.

ghost avatar Jun 03 '17 17:06 ghost

@LilyZL, currently there is no maximum training step setting but you could easily insert such a constraint by grabbing the variable train_step here and altering the while True loop here.

As for how many training steps are necessary: in the paper we required 230k steps to train the pointer-generator model on the CNN/DailyMail dataset. For your Yelp data, you may need a different amount. Currently your model looks under-trained.

abisee avatar Jun 06 '17 16:06 abisee