Wenjie Bai

[email protected]

Tian Jin, China My name is Wenjie Bai. Master of Computer Science, Tianjin University. Research interests: NLP.

Results 1 comments of


                                            Wenjie Bai

[Feature | Bug Fix] <ChatGLM2-6B-int4 使用CPU部署报错：找不到文件quantization_kernels_parallel.so>

经测试，在CPU为`Intel(R) Core(TM) i5-10200H CPU @ 2.40GHz 2.40 GHz`的设备上，推理速度为0.1字/s，占用内存5G~5.4G