Jason Li comments

Repositories
Issues
Comments

Results 3 comments of


                                            Jason Li

llama2 - loss declines too slowly

Have you tried a higher learning rate? I'm noticing the slow loss decline myself here fine-tuning Llama2-7b, comparing to when I fine-tuned Falcon-7b...

can't run llama-2-7b-hf even though I'm using use_auth_token

Yeah I'm also getting the same error with approval from Meta and using the access token from Huggingface and setting use_auth_token = True

can't run llama-2-7b-hf even though I'm using use_auth_token

> Yeah I'm also getting the same error with approval from Meta and using the access token from Huggingface and setting use_auth_token = True I was able to get everything...