betterprompt
betterprompt copied to clipboard
Update perplexity calculation
Need to update the calculation of perplexity to be - Not the perplexity of the prompt but the perplexity of the test completions given the prompt
.
A potential way to structure this is - have it taken in a couple sample test cases, and your prompt, and output perplexity. Could also have it take in multiple prompts.