transformers

transformers copied to clipboard

Add stop sequence to text generation pipeline

10

# What does this PR do? As per the conversation in https://github.com/huggingface/transformers/issues/17562, creating this draft PR to add a stop_sequence option to text generation pipelines. Fixes # (issue) ## Before...

KMFODA

[WIP] german docs translation

4

# What does this PR do? Fixes # (issue) ## Before submitting - [x] This PR fixes a typo or improves the docs (you can dismiss the other checks if...

flozi00

`bitsandbytes` - `Linear8bitLt` integration into `transformers` models

19

# What does this PR do? Adding the mixed 8bit quantization for large language models! 🚀 This feature could reduce the size of the large models by up to 2,...

younesbelkada

Run torch_fx tests in a spawn process to avoid memory issue

1

# What does this PR do? Run torch_fx tests in a spawn process to avoid [memory issue](https://github.com/huggingface/transformers/issues/18525#issue-1331914135).

ydshieh

Add LayoutLMForQuestionAnswering model

8

# What does this PR do? This PR adds a `LayoutLMForQuestionAnswering` class that follows the implementations of `LayoutLMv2ForQuestionAnswering` and `LayoutLMv3ForQuestionAnswering`, so that `LayoutLM` can be fine-tuned for the question answering...

ankrgyl

[Summary] Regarding memory issue in tests

9

### Description This is a short summary of the memory issue in our tests ### The following tests definitely have memory issues - PyTorch (increase ~`15 MB` each call): -...

ydshieh

[TENTATIVe] Attempt to reduce number of HEAD calls during model warmup.

14

# What does this PR do? When doing model loading with the various tools within `transformers` there's actually a lot of duplicate HEAD calls that cost network time and duplicate...

Narsil

Image transforms library

1

# What does this PR do? This is the first of a series of PRs to replace feature extractors with image processors for vision models. Create a new module `image_transforms.py`...

amyeroberts

Test summary with previous PyTorch/TensorFlow versions

8

Initialized by @LysandreJik, we ran the tests with previous PyTorch/TensorFlow versions. The goal is to determine if we should drop (some) earlier PyTorch/TensorFlow versions. - This is not exactly the...

ydshieh

PreTrainedTokenizerFast with tokenizer object is acting on original tokenizer object

2

### System Info - `transformers` version: 4.21.0 - Platform: Windows-10-10.0.19041-SP0 - Python version: 3.9.2 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.8.1+cpu (False) - Tensorflow version (GPU?): not installed...

YBooks