transformers

transformers copied to clipboard

VisionEncoderDecoderModel gradient checkpointing

2

### Feature request Would love to be able to use gradient checkpointing on VisionEncoderDecoder model. >>> model.gradient_checkpointing_enable() Traceback (most recent call last): File "", line 1, in File "/opt/conda/lib/python3.8/site-packages/transformers/modeling_utils.py", line...

metemadi

TFEncoderDecoderModel can not be trained with TF Keras fit() method

3

### System Info - `transformers` version: 4.21.0 - Platform: Linux-4.15.0-188-generic-x86_64-with-glibc2.31 - Python version: 3.9.12 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): not installed (NA) - Tensorflow version (GPU?): 2.6.2...

kmkarakaya

TF to ONNX export fails with large models

4

### System Info - `transformers` version: 4.21.1 - Platform: Linux-4.15.0-187-generic-x86_64-with-debian-buster-sid - Python version: 3.7.5 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): not installed (NA) - Tensorflow version (GPU?): 2.7.0...

cchan-lm

Add EntityPairClassification Pipeline, AutoClass & LUKE ONNX Support

1

# What does this PR do? This PR started out in adding support for Luke in ONNX. To not break existing AutoPatterns in [FeaturesManager](src/transformers/onnx/features.py), [AutoModelForEntityPairClassification](src/transformers/models/auto/modeling_auto.py) has also been added. Additionally,...

kayvane1

Propose file change

1

I am looking to start contributing to OSS on GitHub and trying it out first with some simple grammar fixes.

NoelBram

### System Info Adding image embeddings to layoutLM makes the model unconvertable After following the - https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Add_image_embeddings_to_LayoutLM.ipynb I wanted to convert the .pt model to onnx. The issue is that...

blueprintparadise

openai's CLIP model not working with pytorch 1.12 in some environments

2

### System Info - `transformers` version: 4.20.1 - Platform: Linux-5.4.170+-x86_64-with-glibc2.31 - Python version: 3.9.12 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.11.0+cu113 (True) - Tensorflow version (GPU?): 2.7.0 (False)...

buhrmann

checkpoints_to_be_deleted = checkpoints_sorted[:number_of_checkpoints_to_delete] TypeError: slice indices must be integers or None or have an __index__ method

2

### System Info transformers.__version__==4.9.2 ### Who can help? _No response_ ### Information - [ ] The official example scripts - [x] My own modified scripts ### Tasks - [ ]...

plageon

Wav2Vec 2.0 model output logits related audio pad?

10

### System Info ubuntu 18.04 python 3.6, 3.9 transformers 1.18.0 ### Who can help? @patrickvonplaten, @anton-l ### Information - [X] The official example scripts - [ ] My own modified...

YooSungHyun

BlenderBot-Distil-400M training fails if the input or target length exceeds a certain threshold, even when truncation and padding is on

10

### System Info transformers version: 4.20.1, 4.21.0 Platform: Linux Python version: 3.7.6 Huggingface_hub version: 0.8.1 PyTorch version (GPU?): 1.10.2 (Yes) Tensorflow version (GPU?): not installed (NA) Flax version (CPU?/GPU?/TPU?): not...

shermansiu