spacy-llm icon indicating copy to clipboard operation
spacy-llm copied to clipboard

`transformers` > 4.38 causes bug in inference for HF models

Open rmitsch opened this issue 2 months ago • 0 comments

Inference fails with

TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'pad_token_id'
```. 
Cause for this is unclear so far.

Workaround for the time being is to pin `transformers` to <= 4.38.

rmitsch avatar Apr 24 '24 15:04 rmitsch