CogVLM icon indicating copy to clipboard operation
CogVLM copied to clipboard

Confidence score

Open joel-simp opened this issue 1 year ago • 1 comments
trafficstars

Hi, How to check the confidence score or probability score of the generated text? Throwing me error when I try to find the logits Screenshot 2024-06-19 at 12 20 19 PM

joel-simp avatar Jun 18 '24 10:06 joel-simp

Apply normal ligits using torch and you need to pass output_scores=True to the model.gen function