optimum icon indicating copy to clipboard operation
optimum copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

BetterTransformer for florence2

Open ksooklall opened this issue 6 months ago • 2 comments

Feature request

NotImplementedError: The model type florence2 is not yet supported to be used with BetterTransformer. Feel free to open an issue at https://github.com/huggingface/optimum/issues if you would like this model type to be supported.

Motivation

Florence-2 is a small (compared to other vLLM) and widely used model thus a speed up in inference will be very helpful for everyone

Your contribution

I can help with a PR but I would need some guidance.

ksooklall avatar Aug 22 '24 03:08 ksooklall