CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Support Baichuan2?

Open lx0126z opened this issue 9 months ago • 7 comments

Baichuan2 is a generative model similar to llama, I find the following two differences:

    1. qkv merge as W_pack, so i change the file /ctranslate2/converters/transformers.py image
    1. rotary changes to alibi, so i change the file /ctranslate2/converters/transformers.py image

But I found that the conversion only worked on simple sentences, complex sentences would not work.

Could you help me or is there a plan to support Baichuan2?

  • link https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat/blob/main/modeling_baichuan.py

lx0126z avatar Sep 13 '23 08:09 lx0126z