ocannl icon indicating copy to clipboard operation
ocannl copied to clipboard

Enable mixed precision (e.g. softmax attention using single-precision, rest using half-precision)

Open lukstafi opened this issue 2 years ago • 0 comments

It would probably mean emitting different instructions in Ndarray. Propagating the setting in Formula might be tricky since it needs to be partially top-down.

lukstafi avatar Jan 24 '23 16:01 lukstafi