Synet icon indicating copy to clipboard operation
Synet copied to clipboard
verified publisher icon ermig1979

Can it support ggml as BLAS layer?

Open znsoftm opened this issue 2 years ago • 1 comments

ggml.ai can quantize a model to int4/8, and can seed up the inference of a model.

znsoftm avatar Jul 03 '23 22:07 znsoftm

https://github.com/ggerganov/ggml

znsoftm avatar Jul 03 '23 22:07 znsoftm