Baichuan-13B icon indicating copy to clipboard operation
Baichuan-13B copied to clipboard

Published 20 hours ago • verified publisher icon baichuan-inc

有没有支持cpp推理

Open liaoweiguo opened this issue 1 year ago • 3 comments

liaoweiguo avatar Jul 11 '23 14:07 liaoweiguo

希望能支持苹果GPU

liaoweiguo avatar Jul 12 '23 06:07 liaoweiguo

新版llamacpp貌似有支持了

CRGBS avatar Jul 12 '23 13:07 CRGBS

新版llamacpp貌似有支持了

支持7B，不支持13B

liaoweiguo avatar Jul 13 '23 07:07 liaoweiguo

I implemented Baichuan13b-cpp. Try it if you are interested.

https://github.com/ouwei2013/baichuan13b.cpp

ouwei2013 avatar Jul 18 '23 08:07 ouwei2013