transformers

transformers copied to clipboard

Training with fp16 precision gives nan in Longt5

13

### System Info - `transformers` version: 4.10.0.dev0 - Platform: Linux-3.10.0-1160.62.1.el7.x86_64-x86_64-with-glibc2.17 - Python version: 3.8.13 - PyTorch version (GPU?): 1.9.0+cu111 (False) - Tensorflow version (GPU?): not installed (NA) - Flax version...

Leonard907

attention_mask bug when training Wav2Vec2ForCTC with DeepSpeed

1

### System Info - `transformers` version: 4.19.2 - Platform: Linux-4.15.0-144-generic-x86_64-with-glibc2.27 - Python version: 3.8.13 - Huggingface_hub version: 0.7.0 - PyTorch version (GPU?): 1.7.1+cu110 (True) - Tensorflow version (GPU?): not installed...

ddobokki

Export bert to onnx failed

2

### System Info - `transformers` version: 4.17.0 - Platform: Linux-4.15.0-167-generic-x86_64-with-debian-buster-sid - Python version: 3.7.6 - Onnx version: 1.12.0 - PyTorch version (GPU?): 1.10.1+cu111 (True) - Tensorflow version (GPU?): not installed...

nonstopfor

dictionary update sequence element #5 has length 1; 2 is required

6

### System Info - `transformers` version: 4.20.0.dev0 - Platform: Linux-5.4.0-66-generic-x86_64-with-glibc2.31 - Python version: 3.9.12 - Huggingface_hub version: 0.7.0 - PyTorch version (GPU?): 1.11.0 (False) - Tensorflow version (GPU?): not installed...

skye95git

Add Jukebox model (replaces #16875)

4

This is a draft pull request. # What does this PR do? This PR will progressively add the [Jukebox](https://openai.com/blog/jukebox/) model to the hub. It is linked to [#16870](https://github.com/huggingface/transformers/issues/16870). # Currently...

ArthurZucker

Add fast tokenizer for BARTpho

33

This PR is to add a "fast" BARTpho tokenizer (backed by HuggingFace's *tokenizers* library). # What does this PR do? Fixes # (issue) ## Before submitting - [ ] This...

datquocnguyen

[WIP]Add splinter test tokenization file

13

# What does this PR do? This PR adds test tokenization file for Splinter. It inherits from BERT Tokenizer. Contributes fixes to issue https://github.com/huggingface/transformers/issues/16627 ## Before submitting - [ ]...

farahdian

Model Request: Blenderbot 2.0

26

# 🌟 New model addition ## Model description Facebook released Blenderbot 2.0, a chatbot that builds on RAG and Blenderbot 1.0. It can save interactions for later reference and use...

Xirider

FSDP - TypeError: load_state_dict() got an unexpected keyword argument 'strict'

2

### System Info ``` - `transformers` version: 4.22.0.dev0 - Platform: Linux-5.4.0-1072-aws-x86_64-with-debian-buster-sid - Python version: 3.7.10 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.12.0+cu102 (True) - Tensorflow version (GPU?): not...

shrinath-suresh

T5Tokenizer Fast and Slow give different results with AddedTokens

4

When adding a new token to T5TokenizerFast and/or T5Tokenizer, we get different results for the tokenizers which is unexpected. E.g. running the following code: ```python from transformers import AutoTokenizer, AddedToken...

patrickvonplaten