CPM-Bee issues

[BUG]text 中含有"<"时 tokenizer 报错，

1

运行下面的代码会报错，经过测试是因为含有"

uloveqian2021

import error, undefined symbol: ncclBroadcast

9

I'm trying the demo code, here is the information: with CUDA 12.1 the command `!python -c "import torch;print(torch.cuda.nccl.version())"`, can return `(2, 14, 3)` below is the original import error stack:...

yyq

Environment

是否支持流式输出？

在生成文本时，怎么能做到流式输出呢？

izhaolinger

enhancement

微调GPU需求

5

微调10B模型有推荐的GPU要求么，比如说至少多少内存l? 20G内存和单张3090是推理的需求吧，如果要跑finetune 10B模型，最少要几张3090呀, 支持QLora, ptuning这种节约计算的形式么?

baihuajun24

Where is /your/model/checkpoint in the code:model.load_state_dict(torch.load("/your/model/checkpoint"))?

1

I have download the model cpm-bee-10b from huggingface ,but I do not understand the path of /your/model/checkpointin. Can you someone please guide me to solve this problem?

backatonesJ