Ivan Lv

icon location China icon location Practice makes perfect.

Results 1 issues of Ivan Lv

可以 batch 推理吗？chatglm貌似可以，visualglm该如何做呀？

7 comment

```python def test_batch_generation(self): model, tokenizer = get_model_and_tokenizer() sentences = [ "你好", "介绍一下清华大学" ] parameters = [(False, 2048, 1), (False, 64, 1), (True, 2048, 1), (True, 64, 1), (True, 2048, 4)]...