optimum
optimum copied to clipboard
π Accelerate training and inference of π€ Transformers and π€ Diffusers with easy to use hardware optimization tools
The safety checker is not working with OVStableDiffusionPipeline. ### System Info ```shell - `diffusers` version: 0.23.0 - Platform: Windows-10-10.0.22631-SP0 - Python version: 3.11.0 - PyTorch version (GPU?): 2.0.1+cpu (False) -...
### Feature request Currently, ORTModel has a hard dependency on `torch` and `transformers`. Could we make it such that this dependency is soft, and that Optimum + ORTModel can be...
### System Info ```shell optimum 1.9.1 onnx 1.14.0 onnxconverter-common 1.13.0 onnxruntime 1.15.1 onnxruntime-tools 1.7.0 tf2onnx 1.14.0 transformers 4.31.0 torch 2.0.1 torchaudio 2.0.2 torchvision 0.15.2 ``` ### Who can help? Hi,...
### Feature request I want to export my model to onnxοΌbut an error was happend, like, xxx is not support. such as, if I want export a blip model "Salesforce/blip-image-captioning-large"...
Hello! I am looking to export an image captioning Hugging Face model to ONNX (specifically I was playing with the [git-large](https://huggingface.co/microsoft/git-large) model but if anyone knows of one that might...
### System Info ```shell Python 3.9.16 optimum 1.13.2 Ubuntu 20.04.6 LTS ``` ### Who can help? @michaelbenayoun ### Information - [X] The official example scripts - [ ] My own...
### System Info ```shell - optimum : 1.14.1 - huggingface_hub version: 0.19.4 - Platform: Linux-3.10.0-1160.88.1.el7.x86_64-x86_64-with-glibc2.17 - Python version: 3.9.17 - Running in iPython ?: No - Running in notebook ?:...
# What does this PR do? Two things need to be updated in transformers: 1. Fix casting [here](https://github.com/huggingface/transformers/blob/fa21ead73db473d88f8eca1ec244aba776fd9047/src/transformers/models/clipseg/modeling_clipseg.py#L1290), [here](https://github.com/huggingface/transformers/blob/fa21ead73db473d88f8eca1ec244aba776fd9047/src/transformers/models/clipseg/modeling_clipseg.py#L199), and [here](https://github.com/huggingface/transformers/blob/fa21ead73db473d88f8eca1ec244aba776fd9047/src/transformers/models/clipseg/modeling_clipseg.py#L175) 2. Add the following line [here](https://github.com/huggingface/transformers/blob/fa21ead73db473d88f8eca1ec244aba776fd9047/src/transformers/models/auto/modeling_auto.py#L549): ```py ("clipseg", "CLIPSegForImageSegmentation"),...
## `BetterTransformer` integration for more models! `BetterTransformer` API provides faster inference on CPU & GPU through a simple interface! Models can benefit from very interesting speedups using a one liner...
### Feature request longT5 BetterTransformer implementation ### Motivation Encoder-decoder model trained on large context allow machine translation tasks ### Your contribution I looked at the implementation of regular T5 and...