Lesi Chen

icon indicating a website link https://TrueNobility303.github.io/

icon company Tsinghua University icon location Beijing icon location PhD student, IIIS, Tsinghua University

Results 4 issues of Lesi Chen

这笔记记得有点好啊，这两天期末就靠这个救我了 :)

3 comment

Cannot reproduce the results for RoBERTa on SST-2

1 comment

Hello, Thank you for your fantastic work. When I ran the codes for RoBERTa on SST-2, I found the results could not be reproduced. For instance, for FT (full parameter...

Model collapse

5 comment

Hi! Dear authors, Thanks for your excellent work! I train the CLLM model on GSM8k with Abel-7B-001 as the teacher model, using the dataset `cleaned_gsm8k_jacobi` dataset you provided on hugginface,...

Only has 0.44 accuracy on GSM8K after running the provided codes

7 comment

Dear authors, I train the CLLM model on GSM8k with Abel-7B-001 as the teacher model, using the dataset `cleaned_gsm8k_jacobi` dataset you provided on huggingface, and run the train_cllm.sh, and set...