candle icon indicating copy to clipboard operation
candle copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Quantization Error unsupported safetensor dtype F8_E4M3

Open AlpineVibrations opened this issue 8 months ago • 0 comments

Using tensor-tools to quantize a flux finetine at little-lake-studios/demoncore-flux on hf hub https://huggingface.co/little-lake-studios/demoncore-flux/

tensor-tools quantize demonCORESFWNSFW_fluxV13.safetensors --out-file Q8_0.gguf --quantization q8_0

gets an error

Error: unsupported safetensor dtype F8_E4M3

AlpineVibrations avatar Apr 10 '25 18:04 AlpineVibrations