xiaoxiaosuaxuan

QNN_TARGET_ARCH when running qnn-model-lib-generator and qnn-context-binary-generator

2

I want to run a neural network on the htp backend on Android device. My host device is linux x64. Following the documentation https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/qnn_tutorial_linux_host_linux_target.html?product=1601111740009302, I first use qnn-model-lib-generator to get...

Does aimet and qnn htp backend support weight-only quantization?

1

Does aimet and qnn htp backend support weight-only quantization? For example, the activation is fp16, and weight is 4bit/8bit quantized. Or does qnn htp backend support fp16 matmul? If so,...