Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

transfomers VLM base model change

Open Tcc0403 opened this issue 6 months ago • 0 comments

🚀 The feature, motivation and pitch

Upcoming refactor in transformers VLM models: https://github.com/huggingface/transformers/pull/37033

XXXForConditionalGeneration no longer has language_model attribute for ForCausalLM. It will be changed to model attribute to hold the base model instead.

The patchings (monkey_patch and flce forward method) of VLMs in Liger Kernel will have to confront the changes.

Alternatives

No response

Additional context

No response

Tcc0403 avatar May 15 '25 00:05 Tcc0403