llama2.c icon indicating copy to clipboard operation
llama2.c copied to clipboard

llama2.c calculation in FP16

Open ztachip opened this issue 5 months ago • 0 comments

Is it possible to replace all calculation in float32 with float16? How would this impact accuracy? Is this attempted before?

ztachip avatar Sep 20 '24 12:09 ztachip