ocannl icon indicating copy to clipboard operation
ocannl copied to clipboard

Implement support for quantization

Open lukstafi opened this issue 2 years ago • 3 comments

The part that's a bit confusing is dynamic indexing. For consistency, the underlying integers still need to be scaled before becoming the indexing integers.

lukstafi avatar May 03 '23 18:05 lukstafi

It's probably more interesting than it is practical...

lukstafi avatar May 04 '23 10:05 lukstafi

Let's consider this together with figuring out how to support Float16.

lukstafi avatar May 04 '23 10:05 lukstafi

This isn't really worthwhile, we would rather need the significantly harder support for quantization.

lukstafi avatar Sep 27 '23 11:09 lukstafi