gpt-prompt-engineer icon indicating copy to clipboard operation
gpt-prompt-engineer copied to clipboard

Does set logit_bias to 100 lead the model choice between 'A' and 'B' essentially random?

Open vegetax opened this issue 1 year ago • 2 comments

logit_bias={ '32': 100, # 'A' token '33': 100, # 'B' token }, I asked GPT4 this issue, the following is its answer: image

vegetax avatar Jul 13 '23 04:07 vegetax

Not random! It essentially just excludes any other tokens.

mshumer avatar Jul 13 '23 23:07 mshumer

Unlike the explanation in the gpt-4 response, I think as @mshumer already said it just limits the output to either 'A' or 'B'.

Phq-art avatar Jul 26 '23 09:07 Phq-art