Question about the model size

[Tebmer]

Thanks for your awesome work and open your model weights!

I have one small question that why the size of 13B model weights in Huggingface https://huggingface.co/openbmb/UltraLM-13b/tree/main is roughly 53GB? (The original 13B LLAMA model is around 26GB) :)

[yulinchen99]

Hi, thanks for your interest in our work. The reason is that we saved the delta weights in torch.float32, so it is almost twice as large.