optimum-intel

optimum-intel copied to clipboard

Add transformers v4.45 support

1

Following https://github.com/huggingface/optimum/pull/2023

echarlaix

Patch model for common usage

2

The ipex patching is a common optimization for all tasks, so we can remove the task limitation.

jiqing-feng

fix config saving for openvino model

4

# What does this PR do? in same cases optimum cli failed to export models due to inability to save config because it may contains some extra arguments, I added...

eaidova

Incorrect `chat_template` in `tokenizer_config.json`

2

**Optimum creates a wrong chat_template config when running on linux.** Using optimum-cli to conver llama 3.1 8b to int4 compression, the model fails to run using [samples from genai repo](https://github.com/openvinotoolkit/openvino.genai/tree/master/samples/python/chat_sample)....

taxmeifyoucan

task specific openvino diffusion pipelines

1

# What does this PR do? Fixes # (issue) ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

IlyasMoutawwakil

As titled

kaixuanliu

OVModelForVisionCausalLM

2

# What does this PR do? Enables conversion and inference for multimodality llm like llava, llava-next, falcon-vl Example of usage: ``` from PIL import Image import requests from optimum.intel.openvino import...

eaidova

Faster CI

1

# What does this PR do? Fixes # (issue) ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

IlyasMoutawwakil