UNO icon indicating copy to clipboard operation
UNO copied to clipboard

UNO FP8 and GGUF

Open SunGreen777 opened this issue 8 months ago • 1 comments

I need support for fp8 and gguf. All proposed third-party repositories require a full 24GB model, and many also re-download T5. FP8 support is claimed but not implemented. Please check.

SunGreen777 avatar Apr 24 '25 08:04 SunGreen777

+1

Milor123 avatar Jun 16 '25 17:06 Milor123