Nguyen-Khang Le

icon company Japan Advanced Institute of Science and Technology

Results 1 comments of Nguyen-Khang Le

Compute perplexity/logits for the prompt

I think you can use the parameter `prompt_logprobs` in `SamplingParams` for this purpose. #1328