OpenSourceRonin
OpenSourceRonin
Hi @ewof and @Vahe1994, No offense intended. AQLM is a fantastic project, and VPTQ has acknowledged your work in its acknowledgments. I've successfully reproduced the VPTQ method and released several...
We have uploaded converted models at here https://huggingface.co/collections/opensourcerelease/deepseek-v3-bf16-676d7fa1b3f500d39f8f559b
> I mean, how you convert from pytorch format into safetensor formats? Any documentation there? just run this one https://github.com/deepseek-ai/DeepSeek-V3/blob/main/inference/fp8_cast_bf16.py ```bash python fp8_cast_bf16.py --input-fp8-hf-path INPUT_PATH --output-bf16-hf-path OUTPUT_PATH ```