lhtpluto

知识库加载完成 Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 4/4 [00:12

提问后，回答问题异常： The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. Setting...

期待中

> xif可用么 llm没问题 但 2024-07-25 23:25:13,224 transformers.dynamic_module_utils 20594 INFO Patched resolve_trust_remote_code: (False, '/root/.xinference/cache/bge-base-zh-v1.5', True, False) {} 2024-07-25 23:25:13,227 transformers.modeling_utils 20594 INFO loading weights file /root/.xinference/cache/bge-base-zh-v1.5/pytorch_model.bin 2024-07-25 23:25:13,287 transformers.modeling_utils 20594 INFO...

感觉是没有从Xinference中读到运行的embedding 导致的

> > xif可用么 > > xif可用，但是还是报以上错误。 默认选用的 Embedding 名称： bge-m3 用bge-m3后这步能过去，但仅限于这步，后面上传文件还会报错 File is not a zip file

I discovered that LM Studio also encountered this issue. Mac Studio Apple M3 Ultra DIFY 1.4.0 1.4.1 LM Studio 0.3.16 2025-06-11 00:04:25 [INFO] [LM STUDIO SERVER] Running chat completion on...

> 我重新编译了ktransformersops,然后替换了原来的，解决了问题，可以试试 > > 1. 下载main的源码包，解压进入主目录。 > 2. cd ktransformers/ktransformers/ktransformers_ext/cuda/ > 3. python setup.py develop > 4. ln -sf ktransformers/ktransformers/ktransformers_ext/cuda/KTransformersOps.cpython-311-x86_64-linux-gnu.so $YOURCONDAPATH/lib/python3.11/site-packages/KTransformersOps.cpython-311-x86_64-linux-gnu.so 这个解决了问题 it worked xeon 8581c faster 10%

1.4.0 同样遇到这个问题