ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Can GGML apply in CNN or RCNN ?

Open znsoftm opened this issue 2 years ago • 2 comments

This quantization scheme can speed up the inference of neural networks, but there still is less example in CNN or RCNN, even RNN. Is these ones not easy on ggml or other reasons?

znsoftm avatar May 29 '23 01:05 znsoftm

It's a matter of implementing the necessary operators. Still, the code base can easily grow out of control, so I'm trying to take it slowly and keep it manageable. Thinking about adding support for implementing custom operators in the user-code.

Anyway, I hope we will eventually provide CNN examples with ggml

ggerganov avatar Jun 18 '23 07:06 ggerganov

thanks:)

znsoftm avatar Jun 26 '23 08:06 znsoftm