lightning-thunder icon indicating copy to clipboard operation
lightning-thunder copied to clipboard

enable HF transformers 4.43.

Open t-vi opened this issue 5 months ago • 1 comments

🚀 Feature

enable HF transformers 4.43

Motivation

HuggingFace Transformers 4.43.0 started using vmap in a path we are hitting:

https://github.com/huggingface/transformers/blob/df12d87d184db59aed00b6b22c2daff7bac95204/src/transformers/masking_utils.py#L347-L351

Pitch

Maybe we can check for the presence and lookaside the recent_torch function to use the older_torch one instead...

t-vi avatar Jul 02 '25 15:07 t-vi

@KaelanDt

t-vi avatar Jul 02 '25 15:07 t-vi