betterprompt icon indicating copy to clipboard operation
betterprompt copied to clipboard

Update perplexity calculation

Open krrishdholakia opened this issue 2 years ago • 0 comments

Need to update the calculation of perplexity to be - Not the perplexity of the prompt but the perplexity of the test completions given the prompt.

A potential way to structure this is - have it taken in a couple sample test cases, and your prompt, and output perplexity. Could also have it take in multiple prompts.

krrishdholakia avatar Dec 20 '22 07:12 krrishdholakia