OrangeUnknownCat
Results
2
comments of
OrangeUnknownCat
I don't really know what is this excuse of "too large, probably not worth implementing". If We can run a 21 gb at fp8 model just fine with 16 GB...
> 170 GB is BF16, you need to shift the right column down by one position... Thank you for pointing that out, fixed it, still it needs to be implemented,...