text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard
verified publisher icon oobabooga

Unable to split models into chunks which are already in safetensors format

Open Slug-Cat opened this issue 2 years ago • 0 comments

Description

I tried to use the convert to safetensors script to break a 13B model into manageable chunks because 25GB at once is pain, but it does not work with the script because the model is already in safetensors format. It would be useful to be able to break models into chunks even if they have already been converted. Screenshot 2023-04-04 175620

Slug-Cat avatar Apr 04 '23 22:04 Slug-Cat