ParlAI
ParlAI copied to clipboard
[BB3] Return token logprobs when scoring or generating.
Patch description
- Updates BB3OPTAgent to pass along the token log-probs returned by OPT. This enables evals that require fine-grained access to that information.
- Also ensures that the following keys are always set whether scoring labels or generating new text:
text,logprobs,token_logprobs
Testing steps Ran a few evaluations from metaseq.
Other information N/A
hey @davides, is this ready for review?
hey @davides, is this ready for review?
Still have a few more local changes to add. I'll clean things up a bit and move it to open once ready.
This PR has not had activity in 30 days. Closing due to staleness.
Hey @davides, should we close this or are you still working on it?
This PR has not had activity in 30 days. Closing due to staleness.