雨飞

The Orion-14B-Chat-Int4 model miss the chat method

3

When I use the Orion-14B-Chat-Int4 model, it meets the following error. ` response = model.chat(tokenizer, messages) File "/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1695, in __getattr__ raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'") AttributeError:...

BGE-M3 模型加载失败

4

调用BGE的M3模型时候，官方的示例代码，出现了下面这个问题。看起来像是transformer版本问题导致的。 sentence-transformers 2.2.2 transformers 4.34.1 FlagEmbedding 1.2.5 ``` Traceback (most recent call last): File "bge_m3_embedding_model.py", line 7, in model = BGEM3FlagModel(BGE_M3_PATH, File "/home/deploy/anaconda3/envs/yyl_env_py388/lib/python3.8/site-packages/FlagEmbedding/bge_m3.py", line 36, in __init__ self.model = BGEM3ForInference(...

[BUG] <title>MiniCPM_V_2_6_INT4 版本执行提示 tensor 异常

2

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...