ChatGLM3-6b Compatibility is expected as soon as possible.

[7010G]

ChatGLM3-6B adopts a newly designed Prompt format, supporting multi-turn dialogues as usual. It also natively supports tool invocation (Function Call), code execution (Code Interpreter), and Agent tasks in complex scenarios.

We have launched open source model API deployment code in OpenAI / ZhipuAI format, which can be used as the backend of any ChatGPT-based application. Currently, you can deploy by running api_server.py in the warehouse

project details: https://github.com/THUDM/ChatGLM3

[blvyoucan]

求大佬支招让fastChat能够实现ChatGLM3-6B的function call功能