encoder-agnostic-adaptation icon indicating copy to clipboard operation
encoder-agnostic-adaptation copied to clipboard

Fix the gold index issue in fetching logprob

Open fangleai opened this issue 4 years ago • 0 comments

In story generation task, the original code fetches incorrect index of "logprob", leading to incorrect perplexity evaluation.

Originally: tgt_in = tgt[:-1] log_probs, attn = ... ... gold = tgt_in

Edited: tgt_in = tgt[:-1] log_probs, attn = ... ... gold = tgt[1:]

fangleai avatar Mar 11 '20 06:03 fangleai