alignment-handbook icon indicating copy to clipboard operation
alignment-handbook copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Misalignment between config_lora.yaml and the model card

Open ChenDRAG opened this issue 2 years ago • 0 comments

Hi, I noticed that in the model card. It says Adam optimizer is used. However, in the config_lora.yaml file, it uses optim: rmsprop. Could you tell me which one is the actual training configuration?

I don't if there are other hyperparameters I didn't notice. Can you align the scripts with the correct model training configuration, please?

ChenDRAG avatar Nov 16 '23 05:11 ChenDRAG