PainlessInferenceAcceleration icon indicating copy to clipboard operation
PainlessInferenceAcceleration copied to clipboard

Published 20 hours ago • verified publisher icon alipay

Do lookahead and repetition_penalty conflict?

Open zhanweiw opened this issue 10 months ago • 1 comments

After enabled repetition_penalty, will it lower lookahead's probability? If yes, any solution for avoiding the conflict?

zhanweiw avatar Apr 07 '24 02:04 zhanweiw