FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

feat: support system messages for DeepSeek-V2

Open congchan opened this issue 1 year ago • 0 comments
trafficstars

Why are these changes needed?

According to the https://huggingface.co/deepseek-ai/DeepSeek-V2-Chat, optional system message is supported.

<|begin▁of▁sentence|>User: {user_message_1}

Assistant: {assistant_message_1}<|end▁of▁sentence|>User: {user_message_2}

Assistant:
<|begin▁of▁sentence|>{system_message}

User: {user_message_1}

Assistant: {assistant_message_1}<|end▁of▁sentence|>User: {user_message_2}

Assistant:

Related issue number (if applicable)

Checks

  • [x] I've run format.sh to lint the changes in this PR.
  • [x] I've included any doc changes needed.
  • [x] I've made sure the relevant tests are passing (if applicable).

congchan avatar May 14 '24 02:05 congchan