JiPiTi.cn
Results
2
comments of
JiPiTi.cn
> CUDA_VISIBLE_DEVICES=0,1 夹在web_demo.py么？
> 0,1都可以看到，但是我用demo.py只能对0生效 tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True) model = AutoModel.from_pretrained("THUDM/chatglm-6b", trust_remote_code=True).half().quantize(8).cuda() model = model.eval() MAX_TURNS = 20 MAX_BOXES = MAX_TURNS * 2 CUDA_VISIBLE_DEVICES = 0,1