airllm icon indicating copy to clipboard operation
airllm copied to clipboard

how to delete the original download model after it has been downloaded

Open ruiguo-bio opened this issue 10 months ago • 1 comments

I use a compression='4bit' when initialise the model. After it has been downloaded, can I delete the original model myself, rather than set "delete-original' when initialising model? Where is the compressed model storage location?

ruiguo-bio avatar Apr 24 '24 09:04 ruiguo-bio

set delete_original to true

ayttop avatar Aug 31 '24 01:08 ayttop