LightCompress icon indicating copy to clipboard operation
LightCompress copied to clipboard

support for new datatypes?

Open guanchenl opened this issue 10 months ago • 0 comments

Hi,

There are some old or new datatypes like mx6/mx9/mxfp4 and nvfp4_e2m1, recently nvidia has support the quantization of DeepSeek-R1 model: https://huggingface.co/nvidia/DeepSeek-R1-FP4

can llmc support such new datatypes in the future?

Best, Guanchen

guanchenl avatar Mar 18 '25 10:03 guanchenl