Fan Yang comments

Repositories
Issues
Comments

Results 4 comments of


                                            Fan Yang

请问一下流式调用怎么弄的？

参考：https://github.com/baichuan-inc/Baichuan-13B/blob/main/web_demo.py#L61

Cannot scroll down while running web_demo.py

huggingface space 似乎和 streamlit 不太兼容，建议本地测试demo，或者使用space+gradio。

Cannot scroll down while running web_demo.py

> huggingface space 似乎和 streamlit 不太兼容，建议本地测试demo，或者使用space+gradio。显存占用和前端应该没关系吧。

sft代码疑问

In this way, when predicting, there is no need to add 'eos_token_id' between different dialogue rounds: The 'label' in the first token ('user_token_id') position of the 'human' part is actually...