airllm
airllm copied to clipboard
how to delete the original download model after it has been downloaded
I use a compression='4bit' when initialise the model. After it has been downloaded, can I delete the original model myself, rather than set "delete-original' when initialising model? Where is the compressed model storage location?
set delete_original to true