nick-gt comments

Repositories
Issues
Comments

Results 2 comments of


                                            nick-gt

Download and saving unsloth/gemma-7b-bnb-4bit to a local folder loses parameters

I'm attempting to fine tune a locally saved model and running into the same issue. My GPU info is below: NVIDIA-SMI 535.161.08 Driver Version: 535.161.08 CUDA Version: 12.2 Tesla T4

Download and saving unsloth/gemma-7b-bnb-4bit to a local folder loses parameters

@danielhanchen yes, I've tried using both true and false.