gaord

[Bug] internlm2 不能使用llama.cpp量化转换

6

### Describe the bug 使用最新的llama.cpp代码（b1874），转化模型时报错： python3 convert.py ../internlm2-chat-20b --outtype f16 /Users/pom/AIGC/llama.cpp-3/gguf-py Loading model file ../internlm2-chat-20b/pytorch_model-00001-of-00021.bin Loading model file ../internlm2-chat-20b/pytorch_model-00001-of-00021.bin Loading model file ../internlm2-chat-20b/pytorch_model-00002-of-00021.bin Loading model file ../internlm2-chat-20b/pytorch_model-00003-of-00021.bin Loading model file...

**例行检查** [//]: # (方框内删除已有的空格，填 x 号) + [x] 我已确认目前没有类似 issue + [x] 我已确认我已升级到最新版本 + [x] 我已完整查看过项目 README，尤其是常见问题部分 + [x] 我理解并愿意跟进此 issue，协助测试和提供反馈 + [x] 我理解并认可上述内容，并理解项目维护者精力有限，**不遵循规则的 issue 可能会被无视或直接关闭** **问题描述** 通过one-api调用gpt-4-vision-preview，小图片（测试用60KB）可以正常返回。大图片（500KB）出错。 [INFO] 2024/02/18...

openai-like api endpoint doesn't work well as before in b1382

2

# Prerequisites Please answer the following questions for yourself before submitting an issue. - [x] I am running the latest code. Development is very rapid so there are no tagged...

couple updates to make it easy to use

2

handle the case when req_querystr is empty string add docker image to be out-of-box ready to use

如题

poetry install ends up with error unexpectedly

2

### Description poetry version: 1.8.2 python: 3.11.7 with conda installed macOS 13.6.5 poetry install exits with the following error: ``` Installing dependencies from lock file Package operations: 1 install, 0...

多轮对话的历史消息对system提示词有干扰

1

首先感谢有你们开源的大模型。 我使用如下提示，做一个企业知识库。发现一个问题，当有历史对话的时候，模型输出会忽视系统提示中的内容。如果没有历史对话的时候，模型能够正确遵从系统提示词中的内容。不知道是不是提示的方法有问题，还是模型有特殊的系统提示标题（不是System）。 感谢！ You are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human User. Always answer as helpfully and logically as possible,...

since updates happened overtime, It would be nice to make a release to luarocks

[Bug]: chatting with assistant broke

7

### Is there an existing issue for the same bug? - [X] I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting - [X] I have checked the existing issues. ### Describe...

api调用场景下，如果大量调用带有图片或视频，产生的聊天记录会导致后台mongo数据库异常

7

程序api调用场景下，如果大量调用带有图片或视频，产生的聊天记录会导致后台mongo数据库异常。这个修改给api客户端一个禁止生成聊天记录的选项，避免这个后果。