exllama icon indicating copy to clipboard operation
exllama copied to clipboard

Published 20 hours ago • verified publisher icon turboderp

Support for Baichuan2 models

Open bernardx opened this issue 2 years ago • 1 comments

Baichuan2 is a new model tha has better overall results compared to the llama. https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat It works with AutoGPTQ, but I encountered some error with exllama.

3997267f0ea6fc9c7992296e90da7bf5

bernardx avatar Sep 09 '23 10:09 bernardx

@bernardx 解决了吗

wut0n9 avatar Oct 12 '23 14:10 wut0n9