FastGPT icon indicating copy to clipboard operation
FastGPT copied to clipboard

After Zhipu updates the GLM-4 model, TOP_P cannot be 1. I hope it can be modified as a model configuration parameter.

Open kuziTony opened this issue 1 year ago • 2 comments

例行检查

  • [x] 我已确认目前没有类似 issue
  • [x] 我已完整查看过项目 README,以及项目文档
  • [x] 我使用了自己的 key,并确认我的 key 是可正常使用的
  • [x] 我理解并愿意跟进此 issue,协助测试和提供反馈
  • [x] 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭

你的版本

  • [ ] 公有云版本
  • [x] 私有部署版本

问题描述 智谱更新GLM-4后更新了新的参数, image 在聊天的代码中查询 image top_p写死了为1 导致在使用GLM-4模型的时候一定会报top_p是非法参数 期待修改 复现步骤

预期结果

相关截图

kuziTony avatar Jan 20 '24 17:01 kuziTony

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Routine inspection

  • [ ] I have confirmed that there is currently no similar issue
  • [ ] I have fully reviewed the project README, as well as Project Documentation
  • [ ] I used my own key and confirmed that my key can be used normally.
  • [ ] I understand and am willing to follow up on this issue, assist with testing and provide feedback
  • [x] I understand and acknowledge the above content, and understand that project maintainers have limited energy. Issues that do not follow the rules may be ignored or closed directly

your version

  • [ ] Public cloud version
  • [ ] private deployment version

Problem Description After Zhipu updated GLM-4, it updated new parameters. image Query in the chat code image top_p is hard-coded to 1. As a result, when using the GLM-4 model, it will be reported that top_p is an illegal parameter. Looking forward to modifying it. Steps to reproduce

expected outcome

Related screenshots

c121914yu avatar Jan 20 '24 17:01 c121914yu

How to fix this temporary before the team release the official patch? Thank you

0000sir avatar Jan 21 '24 13:01 0000sir

可以提个pr删除它,gpt默认也是1,不传也不影响。

c121914yu avatar Jan 23 '24 14:01 c121914yu

我也是发现了这个问题,有什么办法临时能解决下呢?

NonenonoN avatar Jan 24 '24 03:01 NonenonoN

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


I also discovered this problem, is there any temporary solution?

c121914yu avatar Jan 24 '24 03:01 c121914yu

You can use the following methods to temporarily solve the problem. https://github.com/LinyuJupiter/FastGPT-zhipu-api

LinyuJupiter avatar Jan 25 '24 14:01 LinyuJupiter

同样的问题

qy8502 avatar Jan 26 '24 03:01 qy8502

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


same question

c121914yu avatar Jan 26 '24 03:01 c121914yu

You can use the following methods to temporarily solve the problem. https://github.com/LinyuJupiter/FastGPT-zhipu-api

If you want a proxy, lua+openresty will be better. But this proxy idea is not a good solution.

0000sir avatar Feb 02 '24 12:02 0000sir

Found this will be fixed in #804 Wait for new image 🤣👍

0000sir avatar Feb 02 '24 13:02 0000sir

https://github.com/labring/FastGPT/releases/tag/v4.6.8-alpha 已修复

c121914yu avatar Feb 03 '24 10:02 c121914yu