Synet
Synet copied to clipboard
Can it support ggml as BLAS layer?
ggml.ai can quantize a model to int4/8, and can seed up the inference of a model.
https://github.com/ggerganov/ggml