Maloney

Results 5 comments of


                                            Maloney

创建bert类时，传入的标签数“”num_labels=len(label_list) + 1“” 为什么要+1？

+1

Reproduction Failure : 8*A100 40G run opt-13b stage3_RLHF OOM

I encountered the same problem as well.

step 3 : OOM

Hi @EikeKohl ，actor model：LLaMA 7B，critic model：facebook/opt-350m.

step 3 : OOM

@AltenLi 还是不行，老哥，还是显存不够，好奇怪的。

step 3 : OOM

tks bro @yaozhewei 😯