[Discussion] Can anyone show the performance on every step with any dataset

Open EeyoreLee opened this issue 2 years ago • 0 comments

Model Dataset Peft Step Acc PS

llama2-7b Dahoas/full-hh-rlhf LoRA 2 0.64 \

llama2-7b dikw/hh_rlhf_cn/*_cn_* LoRA 2 0.58 \

llama2-7b dikw/hh_rlhf_cn/*_en_* LoRA 2 0.58 \

bert-base-chinese(110m) dikw/hh_rlhf_cn/*_cn_* naive Finetune 2 0.54 \

Model	Dataset	Peft	Step	Acc	PS
llama2-7b	Dahoas/full-hh-rlhf	LoRA	2	0.64	\
llama2-7b	dikw/hh_rlhf_cn/_cn_	LoRA	2	0.58	\
llama2-7b	dikw/hh_rlhf_cn/_en_	LoRA	2	0.58	\
bert-base-chinese(110m)	dikw/hh_rlhf_cn/_cn_	naive Finetune	2	0.54	\

Dec 14 '23 05:12 EeyoreLee