FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Published 20 hours ago • verified publisher icon lm-sys

What is the value of warmup_ratio?

Open alanxmay opened this issue 1 year ago • 0 comments

I'm a little confused, warmup_ratio = 0.03 or warmup_ratio = 0.04?

According to train_vicuna_13b.sh : https://github.com/lm-sys/FastChat/blob/a26db3c814889035d92c8ae80d6defbd7381ee55/scripts/train_vicuna_13b.sh#L17

But the README use: warmup_ratio 0.03.

Also train-vicuna.yaml: https://github.com/lm-sys/FastChat/blob/a26db3c814889035d92c8ae80d6defbd7381ee55/scripts/train-vicuna.yaml#L111

Thanks!

alanxmay avatar May 07 '23 17:05 alanxmay