optimum-intel icon indicating copy to clipboard operation
optimum-intel copied to clipboard

Infer if the model needs to be exported

Open echarlaix opened this issue 1 year ago • 1 comments

As https://github.com/huggingface/optimum-intel/pull/722/ this PR remove the need to specify if the model needs to be exported or not with export

  from optimum.intel import OVModelForCausalLM

- model = OVModelForCausalLM.from_pretrained("gpt2", export=True)
+ model = OVModelForCausalLM.from_pretrained("gpt2")

echarlaix avatar Jul 15 '24 12:07 echarlaix

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.