Tengine icon indicating copy to clipboard operation
Tengine copied to clipboard

int8量化模型推理错误

Open JXJasonnn opened this issue 3 years ago • 2 comments

我将darknet模型转换为tmfile后使用quant_tool_int8将模型量化,然后进行推理,出现如下错误: Tengine: size of tensor != size of buffer(496128 vs 1984512) Set input tensor buffer failed 请问出现上述错误,可能是哪个环节出现了问题呢?诚邀大佬指点,谢谢! (推理分辨率是544*304,量化参数 -w 104 117 123 -s 0.017)

JXJasonnn avatar Jul 20 '21 06:07 JXJasonnn

调分辨率

LJoson avatar Aug 17 '21 13:08 LJoson

应该是你buffer size设置错了吧 uint8的脚本写成fp32的了

huoshuai-dot avatar Aug 25 '21 12:08 huoshuai-dot