ParlAI icon indicating copy to clipboard operation
ParlAI copied to clipboard

[TGA] Factual Nucleus Sampling

Open klshuster opened this issue 3 years ago • 0 comments

Patch description Factual nucleus is a decoding method that decays the nucleus sampling p value over time according to a constant factor lambda_decay. The p value resets when encountering a full-stop (when p_reset is True), and there is a lower bound of omega_bound to what p can decay to.

Testing steps Added Factual Nucleus to the existing tree search tests.

klshuster avatar Nov 18 '22 18:11 klshuster