transformers

transformers copied to clipboard

How to specific customized force_token_ids in whisper

2

``` ValueError: A custom logits processor of type with values has been passed to `.generate()`, but it has already been created with the values . has been created by passing...

MonolithFoundation

Fix: Qwen2 eager attention bug

7

## Bug There are three supported attention modes: `eager`, `sdpa`, and `flash_attention_2` for Qwen2 in transformers. I have evaluated wikitext2 PPL on the Qwen2-7b model under different attention modes. The...

HandH1998

problem with rag

2

### System Info Copy-and-paste the text below in your GitHub issue and FILL OUT the two last points. - `transformers` version: 4.44.2 - Platform: Linux-6.1.85+-x86_64-with-glibc2.35 - Python version: 3.10.12 -...

zahraKane

### System Info - `transformers` version: 4.45.2 - Platform: Linux-5.4.0-1113-oracle-x86_64-with-glibc2.35 - Python version: 3.10.12 - Huggingface_hub version: 0.23.2 - Safetensors version: 0.4.5 - Accelerate version: 0.34.2 - Accelerate config: not...

Infernaught

DataCollatorWithFlattening is incompatible with non - list input ids

2

### System Info latest transformers ### Who can help? @ArthurZucker ### Information - [ ] The official example scripts - [x] My own modified scripts ### Tasks - [ ]...

alex-hh

Make `VisionEncoderDecoderModel.from_pretrained` take different arguments for encoder and decoder

5

### Feature request ```python model = VisionEncoderDecoderModel.from_pretrained("nougat", encoder_kwargs={...}, decoder_kwargs={...}) ``` ### Motivation I want to load VisionEncoderDecoderModel with flash_attention_2 for the decoder only (the encoder is not supporting this to...

MohamedAliRashad

MllamaForCausalLM not returning past_key_values even with use_cache=True

3

### System Info - `transformers` version: 4.45.2 - Platform: Linux-5.4.0-187-generic-x86_64-with-glibc2.31 - Python version: 3.11.5 - Huggingface_hub version: 0.23.4 - Safetensors version: 0.4.3 - Accelerate version: 0.33.0 - Accelerate config: not...

Zhangyanbo

Llama4 inference encounter unsupported op in dynamo ?

7

### System Info transformers==4.51.2 torch==2.5.0 torchvision==0.20.0 Miscellnous pkg version Package Version ------------------------- ----------- accelerate 1.6.0 aiofiles 23.2.1 aiohappyeyeballs 2.6.1 aiohttp 3.11.16 aiosignal 1.3.2 altair 5.5.0 annotated-types 0.7.0 antlr4-python3-runtime 4.9.3 anyio...

HuangChiEn

Replaced the relative link to the notebooks directory in docs/source/it/training.md with an external link to the official Hugging Face Notebooks repository on GitHub. This ensures users can always access the...

VolodymyrBg

[Community contributions] Model cards

117

Hey friends! 👋 We are currently in the process of improving the Transformers model cards by making them more directly useful for everyone. The main goal is to: 1. Standardize...

stevhliu