transformers

transformers copied to clipboard

Add EfficientNet model for PyTorch

3

# What does this PR do? This PR adds the EfficientNet model family to HuggingFace transformers proposed in #15759 (PyTorch only for this PR). The implementation is based on that...

tanaymeh

NaN in XGLM Softmax with FP16

4

### System Info - `transformers` version: 4.21.0.dev0 - Platform: Linux-5.3.0-1017-x86_64-with-glibc2.27 - Python version: 3.9.13 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.12.0+cu102 (True) - Tensorflow version (GPU?): not installed...

gsarti

A basic NLP question regarding NER task

2

Hi @patrickvonplaten, I have one basic conceptual NLP question regarding the evaluation for NER. According to [run_ner.py](https://github.com/huggingface/transformers/blob/main/examples/pytorch/token-classification/run_ner.py), the ground truth label is truncated to max_seq_length during prediction. However, this means...

liususan091219

Include `timeout` attribute (related to DDP) to TrainingArguments

3

### Feature request Would it be possible to include a `timeout` attribute to the `TrainingArguments` dataclass, such as it will be used as an argument of the `torch.distributed.init_process_group` calls? Reference:...

gugarosa

Configurations should support id2label as a list

2

### Feature request This is a rather minor/trivial feature request. Currently `id2label` is of type `Dict[int, str]` in `PretrainedConfig`. Since this map is used to map class ids to labels,...

sijunhe

NLP HydraNet

1

### Feature request I think it would be awesome to be able to easily train a Tesla style HydraNet but using a transformer backbone. The model would take a model_id...

sam-h-bean

Update state.best_metric after model evaluation; track metric for mod…

4

…el checkpointing separately in new state.best_metric_checkpoint variable # What does this PR do? Fixes # (issue) ## Before submitting - [x] This PR fixes a typo or improves the docs...

baskrahmer

### Feature request `torch.nn.Linear,Conv2d...` will call `self.reset_parameters()` inside their `__init__`. I'd like to make `reset_parameters` be a no-op inside `no_init_weights` context manager. ### Motivation `no_init_weights` is used in `from_pretrained` to...

YouJiacheng

### System Info All. ### Who can help? @patrickvonplaten ### Reproduction See https://huggingface.co/docs/transformers/main/en/model_doc/longt5 ### Expected behavior In the above document, it said `Unlike the T5 model, LongT5 does not use...

GabrielLin

Save and load

4

Hello community, I am having the same problem described to save and load a fine tuned model using transformers and tensorflow. I have used save_pretrained, save_weights and model.save with save_format=tf....

LeninGF