Multimodal-Toolkit icon indicating copy to clipboard operation
Multimodal-Toolkit copied to clipboard

Support exporting and importing ONNX models

Open cpetrov opened this issue 4 years ago • 0 comments

This can help leverage hardware optimisations and significantly speed up inference: https://huggingface.co/transformers/serialization.html

It seems this would be only possible with transformers>=4.9.0 (see https://huggingface.co/transformers/serialization.html#configuration-based-approach)), so this issue seems related to https://github.com/georgian-io/Multimodal-Toolkit/issues/3.

cpetrov avatar Aug 30 '21 15:08 cpetrov