transformers
transformers copied to clipboard
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
### System Info - `transformers` version: 4.46.0.dev0 - Platform: Linux-5.15.0-122-generic-x86_64-with-glibc2.35 - Python version: 3.10.14 - Huggingface_hub version: 0.24.7 - Safetensors version: 0.4.5 - Accelerate version: 0.34.2 - PyTorch version (GPU?):...
# What does this PR do? 1. Add `apply_tensor_parallel` API to apply TP plan to Llama and Granite models 2. Introduce `tp_size` user facing argument to be further consumed by...
### Feature request Add support for LlamaGen, an autoregressive image generation model, to the Transformers library. LlamaGen applies the next-token prediction paradigm of large language models to visual generation. Paper:...
### Model description As an OCR-2.0 model, GOT can handle all artificial optical signals (e.g., plain texts, math/molecular formulas, tables, charts, sheet music, and even geometric shapes) under various OCR...
While working on ASR and speaker diarization using - https://github.com/MahmoudAshraf97/ctc-forced-aligner/blob/main/ctc_forced_aligner/alignment_utils.py get_spans function is getting used spans = get_spans(tokens_starred, segments, alignment_tokenizer.decode(blank_id)) check - _decode function in [alignment](https://github.com/huggingface/transformers/blob/main/src/transformers/models/wav2vec2/tokenization_wav2vec2.py) tokenization_utils.py error - ValueError:...
# What does this PR do? This PR adds support for Florence-2. Compared to the existing [remote code](https://huggingface.co/microsoft/Florence-2-base/blob/main/modeling_florence2.py) the main difference is removal of `MySequential`, removal of `einops.rearrange` and `trunc_normal_`...
Some potential issues and documentation improvements in #TRANSLATING.md are: 1. **Clarity in Steps**: Ensure each step is distinct and clearly numbered or bulleted to enhance readability. For example, consider using...
This PR introduces a guide for translating the Transformers documentation into multiple languages as part of the project’s effort to make machine learning more accessible globally. ### Key Changes: -...
### System Info - `transformers` version: 4.43.3 - Platform: Linux-5.15.153.1-microsoft-standard-WSL2-x86_64-with-glibc2.35 - Python version: 3.10.12 - Huggingface_hub version: 0.23.2 - Safetensors version: 0.4.3 - Accelerate version: 0.30.1 - Accelerate config: not...
### System Info transformers 4.44.0 ### Who can help? @ArthurZucker ### Information - [ ] The official example scripts - [X] My own modified scripts ### Tasks - [ ]...