curated-transformers icon indicating copy to clipboard operation
curated-transformers copied to clipboard

Output logits for generation

Open mayankjobanputra opened this issue 1 year ago • 1 comments

For calculating perplexities logits are required. I couldn't find any way to do it currently. Maybe there's already a way, if so, please point me to it.

mayankjobanputra avatar Aug 24 '23 14:08 mayankjobanputra

Thanks for the request! If you're referring to the logits generated by the causal LM, there is currently no way to access them through the Generator interface. We'll look into exposing this in a future release.

shadeMe avatar Aug 25 '23 09:08 shadeMe