OmniParser
OmniParser copied to clipboard
Quantized version
Hi there
Any chance we'll see a quantized version (gguf, onnx, etc) for better CPU performance?
I haven't tried yet using HF's load_in_4bit
kind of options so I'm not sure that would work.