easyllm
easyllm copied to clipboard
[Feature] Add support for logit_bias
Use-case: LMQL and others https://github.com/eth-sri/lmql/issues/190#issuecomment-1686430040
Feature was added to transformers some months ago: https://github.com/huggingface/transformers/issues/22168#issuecomment-1600651405