blis icon indicating copy to clipboard operation
blis copied to clipboard
verified publisher icon flame

Integer GEMM

Open guillaumekln opened this issue 5 years ago • 1 comments

Are there any plans to include an integer GEMM API in the future? 8-bit or 16-bit integer GEMM have become fairly standard for inference of quantized neural networks.

Here are some examples in other libraries:

Thanks!

guillaumekln avatar Jun 11 '20 12:06 guillaumekln

@guillaumekln Thanks for your interest in BLIS. Unfortunately, we don't have the resources at this time to investigate integer support for the gemm operation. We may look into this more seriously at some point in the future, but I'm not sure when that would be.

fgvanzee avatar Jun 12 '20 21:06 fgvanzee