ppl.nn icon indicating copy to clipboard operation
ppl.nn copied to clipboard

(Ask) why InferInheritedType handle int8 to fp16 out?

Open DeepTecher opened this issue 1 year ago • 3 comments

As you described in the docs,

InferInheritedType(info); // All Inputs inherit the type of their previous node’s outputs and sets outputs to the data type of the first input.

But in the code, it seems that you handle int8 for special case. Can you tell me why you do this? https://github.com/openppl-public/ppl.nn/blob/252e7f27eec3976a3be48bb21f15c660cddec6af/src/ppl/nn/engines/cuda/optimizer/opt_kernel.h#L264

DeepTecher avatar Jul 19 '23 05:07 DeepTecher