gehong-coder

About the twitter dataset

9

About the twitter dataset The question of the true and false numbers, that is, how did 7021 5974 come about and why did we reproduce a different result?

作者您好，请问在论文的实验代码中，您放置的测试集也是validate嘛？还需要改成test嘛？image_validation数据是您单独分出来的嘛？

OCR speed

1

Why does the speed of OCR become very slow after using 8 GPUs?

Unsloth这个对cogvlm2-llama3-chinese-chat-19B 推理加速这个会实现吗？

1

model, tokenizer = get_model_tokenizer(model_type, torch.float16,load_in_4bit=True,model_kwargs={'device_map': 'auto'},use_unsloth=True NotImplementedError: Unsloth: .cache/modelscope/hub/ZhipuAI/cogvlm2-llama3-chinese-chat-19B not supported yet!

### Feature request / 功能建议 能否支持加速推理呢 batch infer 代码有嘛？ ### Motivation / 动机 效果很不错，速度能够快一些吗 ### Your contribution / 您的贡献 暂时没有