dabnn icon indicating copy to clipboard operation
dabnn copied to clipboard

Operator requests

Open daquexian opened this issue 5 years ago • 4 comments

Currently dabnn only support primitive operators, such as Conv, FullyConnected, Pool, Add, Concat and ReLU. While they are already enough for many networks (e.g., ResNet, SqueezeNet), some more operators may also be needed for more complicated networks.

Moreover, I believe that the deployment of BNNs needs efforts from both the researchers of BNNs and the engineers of inference frameworks (like dabnn). So there should be a way to enable communication between BNN researchers and dabnn developers.

Therefore, this issue is opened for collecting the request of operators. It helps me to prioritize the various operators. Please reply to this issue if you want some operators that have not been implemented in dabnn, then I will implement them as long as I have enough time.

Requested operators list:

  • [x] PReLU
  • [x] Reshape/Flatten before GEMM

daquexian avatar Jun 10 '19 05:06 daquexian

Shape operator Reshape should not only be for last layer.

custom_convolution.zip

i-amgeek avatar Aug 10 '19 16:08 i-amgeek

@i-amgeek Thanks for your report!

Generally reshape is hard to implement since the difference between NCHW (ONNX) and NHWC (dabnn). However, the cases that reshape is before gemm/matmul are trivial. I'll support them soon.

daquexian avatar Aug 22 '19 09:08 daquexian

Resize, ConvTranspose, Transpose, Clip, LeakRelu, THANK!

xmuLJX avatar Jul 06 '20 13:07 xmuLJX

How about 3D Conv/Pooling layers?

rongzhao-zhang avatar Mar 09 '21 11:03 rongzhao-zhang