transformers

transformers copied to clipboard

Unable to Infer on Bloom Model-2b5 using Deepspeed

2

### System Info I was able to load the Bloom-2b5 Model onto my Colab notebook for text generation(Inference). When I use Deepspeed to load the model and try to inference...

Ravisankar13

Preserve hub-related kwargs in AutoModel.from_pretrained

1

# What does this PR do? As was reported in #18537, when using `AutoConfig` inside the `AutoModel.from_pretrained` method, some kwargs are deleted and not passed to the `from_pretrained` method of...

sgugger

Longformer EncoderDecoder (LED)-Large model finetuning for summarization results in </s><s><s><s><s><s><s><s><s><s><s>... output

9

### System Info - `transformers` version: 4.20.0.dev0 - Platform: Linux-4.18.0-348.23.1.el8_5.x86_64-x86_64-with-centos-8.6-Green_Obsidian - Python version: 3.7.13 - Huggingface_hub version: 0.7.0 - PyTorch version (GPU?): 1.11.0 (True) - Tensorflow version (GPU?): not installed...

ratishsp

AutoModel(s) do not respect the `revision` flag while loading custom models

3

### System Info - `transformers` version: 4.21.1 - Platform: macOS-12.4-arm64-arm-64bit - Python version: 3.10.5 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.12.1 (False) - Tensorflow version (GPU?): not installed...

ankrgyl

Adding TF Implementation of BEiT

4

### Feature request Addition of TF implementation of BEiT ### Motivation I have always seen that there is a discrepancy in the availability of models for PyTorch and the models...

MadElf1337

TF to ONNX export fails with CLI using example from docs

2

### System Info - `transformers` version: 4.21.1 - Platform: Linux-4.15.0-187-generic-x86_64-with-debian-buster-sid - Python version: 3.7.5 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): not installed (NA) - Tensorflow version (GPU?): 2.7.0...

cchan-lm

Add Donut

3

# What does this PR do? This PR adds Donut to the library. Donut is to LayoutLM what T5 is to BERT. :D The model is implemented as an instance...

NielsRogge

Flax Remat for LongT5

6

# What does this PR do? Following on from the discussion in https://github.com/huggingface/transformers/issues/17399 this PR adds remat (flax's gradient checkpointing) to LongT5. Most of the code is copied from https://github.com/huggingface/transformers/pull/17843/files...

KMFODA

[WIP] [deepspeed] from_pretrained deal with ignore_mismatched_sizes

3

An attempt to fix the issue reported https://github.com/huggingface/transformers/issues/17336 Fixes: https://github.com/huggingface/transformers/issues/17336

stas00

Text classification pipeline outputs differ with 4.20

4

### System Info ```shell transformers 4.20.0 ``` ### Who can help? @Narsil ### Information - [ ] The official example scripts - [ ] My own modified scripts ### Tasks...

davidmezzetti