AMDMIGraphX icon indicating copy to clipboard operation
AMDMIGraphX copied to clipboard

Add verification for `--int8` and `--fp16 --int8` and `--fp8` in `migraphx-driver`

Open umangyadav opened this issue 1 year ago • 0 comments

migraphx-driver doesn't seem to quantize to int8 or fp8 https://github.com/ROCm/AMDMIGraphX/blob/1199fbeeb83539a5cb6a033745e67bfb661875ca/src/driver/verify.cpp#L97

Need to add quantization for 8 bits and combination of --fp16 --int8.

umangyadav avatar Apr 30 '24 14:04 umangyadav