transformers

transformers copied to clipboard

Add missing lang tokens in M2M100Tokenizer.get_vocab

1

# What does this PR do? The lang tokens were missing from `M2M100Tokenizer.get_vocab`. The `get_vocab` method is updated to match other multilingual tokenizers such as `NllbTokenizer` and `MBart50Tokenizer`. ## Before...

guillaumekln

Fix DisjunctiveConstraint edge case and add ConjunctiveDisjunctiveConstraint

8

# What does this PR do? - implement [`AC automaton`](https://en.wikipedia.org/wiki/Aho%E2%80%93Corasick_algorithm) to supersede Trie to fix DisjunctiveConstraint edge case - add ConjunctiveDisjunctiveConstraint to handle the complex combinations between multiple conjunctive and...

boy2000-007man

### Feature request Add TF implementation of LongT5 model ### Motivation Add support for TF backend to allow using LongT5 with TF. ### Your contribution I will add this :]...

stancld

[New Model] DocFormer: End-to-End Transformer for Document Understanding

11

# 🌟 New model addition ## Model description See _"DocFormer: End-to-End Transformer for Document Understanding", Appalaraju et al (ICCV 2021)_ on [CVF](https://openaccess.thecvf.com/content/ICCV2021/papers/Appalaraju_DocFormer_End-to-End_Transformer_for_Document_Understanding_ICCV_2021_paper.pdf) and [arXiv](https://arxiv.org/abs/2106.11539) DocFormer is a multi-modal transformer model...

athewsey

Change BartLearnedPositionalEmbedding's forward method signature to support Opacus training

8

As outlined in #18425, this PR changes the signature of `BartLearnedPositionalEmbedding`'s forward method signature to take the `input_ids` tensor (and not just its shape). This is needed to enable private...

donebydan

Add ONNX support for Longformer

15

# What does this PR do? This PR contributes to #16308 and addresses #16463 by adding support for exporting [Longformer](https://arxiv.org/abs/2004.05150) to ONNX. The following necessary changes were already made: -...

deutschmn

Add Mask2Former

5

### Model description Mask2Former is a single architecture for panoptic, instance and semantic segmentation. **Mask2Former Paper Abstract**: Image segmentation is about grouping pixels with different semantics, e.g., category or instance...

shivalikasingh95

## Environment info ``` - `transformers` version: 4.17.0 - Platform: Linux-5.4.144+-x86_64-with-Ubuntu-18.04-bionic - Python version: 3.7.12 - PyTorch version (GPU?): 1.10.0+cu111 (False) - Tensorflow version (GPU?): 2.8.0 (False) - Flax version...

SaulLu

ONNXConfig: Add a configuration for all available models

58

This issue is about the working group specially created for this task. If you are interested in helping out, take a look at this [organization](https://huggingface.co/OWG), or add me on Discord:...

chainyo

Question on model_max_length (DeBERTa-V3)

9

### System Info ```shell - `transformers` version: 4.18.0 - Platform: macOS-10.16-x86_64-i386-64bit - Python version: 3.8.3 - Huggingface_hub version: 0.5.1 - PyTorch version (GPU?): 1.5.1 (False) - Tensorflow version (GPU?): 2.4.0...

ioana-blue