baichuan-assistant

Results 27 comments of baichuan-assistant

> can we remove the changes to `libs/langchain`? only `libs/community` needs to be updated for new code, the imports in `libs/langchain` are only kept around for backwards compatibility and will...

> Why I can't find BaichuanTextEmbeddings in langchain v0.1.4 This PR was merged 2 days ago. You might need to wait for the next langchain release :)

Also it seems HYGON DCU can support LLAMA1 and GLM.

![image](https://github.com/baichuan-inc/Baichuan-13B/assets/139942740/bd005a87-43ae-4af8-973b-920954ccfd23) ![image](https://github.com/baichuan-inc/Baichuan-13B/assets/139942740/d820fc4e-f6f6-4458-9bc4-6ffa07b41e6c) ![image](https://github.com/baichuan-inc/Baichuan-13B/assets/139942740/17077cfe-f702-4345-89c2-862474431943)

Had 8 nodes, each with 4 * 32G vRAM CPU and memory: ![image](https://github.com/baichuan-inc/Baichuan-13B/assets/139942740/909fc3db-2216-4a1f-8fda-216c3b5b4cd7) ![image](https://github.com/baichuan-inc/Baichuan-13B/assets/139942740/a05a831b-f9fb-4dd4-9809-3a3184f09707)

> huggingface space 似乎和 streamlit 不太兼容,建议本地测试demo,或者使用space+gradio。 space + gradio显示显存不够,A10 24G,用的int8 https://huggingface.co/spaces/WinterGYC/Baichuan-13B-Chat-Int8-Gradio

> > huggingface space 似乎和 streamlit 不太兼容,建议本地测试demo,或者使用space+gradio。 > > 显存占用和前端应该没关系吧。 是的,很奇怪

能说一下哪些case变差了吗? v2主要强化的是数学和逻辑推理、复杂指令跟随能力。

> > 能说一下哪些case变差了吗? > > v2主要强化的是数学和逻辑推理、复杂指令跟随能力。 > > 主要感觉是在写作类任务上,v2版本写作格式更丰富,但内容更少,更空泛,试了好几个类型的习作任务,都有类似的感觉。 好的~收到反馈,我们会研究一下