Shrey Gupta

icon indicating an email [email protected]

icon location Mountain View, CA icon location Sometimes I write Python code and other times it runs.

Results 1 issues of Shrey Gupta

Unable to do inference on Falcon-40b fine-tuned using LORA

6 comment

Hi everyone, I was able to finetune a Falcon-4b model using the finetune/lora.py script. Now, I am trying to generate responses using the generate/lora.py script, but it gets stuck loading...