generative-ai-python icon indicating copy to clipboard operation
generative-ai-python copied to clipboard

Add min_p #680

Open demoncoder-crypto opened this issue 8 months ago • 0 comments

Generates text one token at a time. At each step, it requests many (num_samples) candidates for the next single token. Estimates the probability of each potential next token based on its frequency in the candidates. Applies the min_p filtering logic using these estimated probabilities.

demoncoder-crypto avatar Mar 28 '25 12:03 demoncoder-crypto