Junrong Lin comments

Repositories
Issues
Comments

Results 3 comments of


                                            Junrong Lin

FastChat as a backend service to support more models

Hi @bluechanel , thx for PR. Since the current open-source solution is entirely based on fastchat. How about also refactor the `opensource model`?

feat: Add serve module and cli tools

Hi! @dandansamax @Wendong-Fan Do you have time to take a look at this PR and give me some feedback?

[Feature Request] message_to_prompt -> .apply_chat_template

Emmm ok I see some inflexibilities of directly applying this method like it cannot apply to a single message but should be a chat history. During inference it is fine...