chat-ui icon indicating copy to clipboard operation
chat-ui copied to clipboard

deepseek coder Prompt template

Open GANJAC opened this issue 1 year ago • 2 comments

Hi everyone, for my project i want to use chat-ui with this model served by llama.cpp server:

https://huggingface.co/TheBloke/deepseek-coder-6.7B-instruct-GGUF

Please, can someone give me the correct "chatPromptTemplate" to use in .env file ?

Any suggestions are super appreciated!

Thank you all!

GANJAC avatar Jan 25 '24 15:01 GANJAC

Hi @nsarrazin please help me, this is the chat template:

You are an AI programming assistant, utilizing the DeepSeek Coder model, developed by DeepSeek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer.
### Instruction:
['content']
### Response:
['content']
<|EOT|>
### Instruction:
['content']
### Response:

How do i format the ChatPromptTemplate ?

GANJAC avatar Feb 05 '24 14:02 GANJAC

You are an AI programming assistant, utilizing the Deepseek Coder model, developed by Deepseek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer.\n{{#each messages}}{{#ifUser}}### Instruction:\n{{content}}\n{{/ifUser}}{{#ifAssistant}}### Response:\n{{content}}\n<|EOT|>\n{{/ifAssistant}}{{/each}}### Response:\n

Grey4sh avatar Feb 26 '24 03:02 Grey4sh