Bruce Lv comments

Repositories
Issues
Comments

Results 4 comments of


                                            Bruce Lv

使用lora微调baichuan2-7b-base，3*V100（16G），还是OOM？到底需要多少内存

官方能输出说一下吗？我用了5张V100（16G），合计80G，用lora还是OOM，到底需要多少内存？之前用baichuan1-base，2张V100就够了啊，怎么回事？？？？？

在dsw安装魔塔报错

pip install modelscope==1.4.3 -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html 也报错

Evaluate on long context (32k,64k etc..) on 30B/70B large models

> You are right. We will update soon to also support 30B/70B models with accelerate/deepspeed. waiting

Evaluate on long context (32k,64k etc..) on 30B/70B large models

> Hi, > > I found that the original script cannot handle large models on long context effectively, since it use multiprocess to load an entire model on a single...