onnxt5
onnxt5 copied to clipboard
Can this be used with Flan-T5?
Specifically, I am using google/flan-t5-large in a Colab, but the inference time is rather slow for my needs. Can it benefit from onnxt5?