How to answer search results in Chinese!

[tc0715888]

How to answer search results in Chinese!

[ng-fukgin]

你在后台把{"role": "user", "content": query},改成{"role": "user", "content": query+"请把你的回答翻译成中文"},很大几率会回答中文

[hejxiang]

Query by chinese and use a chinese model as the backend llm, like qwen, then the default output will be chinese

[tc0715888]

How to set the backend as "qwen", can you provide guidance?

[ng-fukgin]

How to set the backend as "qwen", can you provide guidance?

你先自己用fastchat也好，什么也好，自己部署一个类似于openai 的api 的接口，然后修改 base_url=f"https://{self.model}.lepton.run/api/v1/",这一个链接，例如base_url=f"https:localhost:8000/v1/", 然后修改"LLM_MODEL": "mixtral-8x7b",这里的模型名字，就可以了，qwen不会生成Related，可能会报错，但不影响模型的回答。