tankxiaodi

同问

@cgutman Thanks a lot, I've upgraded to a Qualcomm 870 device and 3ms and so.

You might need to check the tensorflow-2.7.2 branch.

You must follow the instructions strictly to install TensorFlow and its dependencies.

It only works with the old version of Python, like 3.6.9. I'd suggest you install it in a python virtual environment.

感谢楼上兄弟， 我用了你的设置在Mac上成功跑起了，M1 Max + 64G内存速度可以接受。 不过今天看到有人搞了ggml的版本: https://huggingface.co/xuqinyang/baichuan-13b-chat-ggml-int8

一个Mac就能跑，还要什么自行车