DeepSeek-Coder-V2 icon indicating copy to clipboard operation
DeepSeek-Coder-V2 copied to clipboard
verified publisher icon deepseek-ai

Hi, I have a question about fine tuning.

Open Yindy07 opened this issue 1 year ago • 0 comments

  1. when inferring from a model to FIM, I want to fine-tune it with a dataset, but the format of the dataset is {"instruction" : "", "output": ""} should I use this format, or should I add tokens such as ? "<｜fim▁hole｜>" "<｜fim▁begin｜>", etc.

  2. when inferring the model, I am using a template like <｜fim▁begin｜>{prefix}<｜fim▁hole｜>{suffix}<｜fim▁end｜>, is this correct? For example : "<｜fim▁begin｜> handleMoveFocus = (<｜fim▁hole｜>) => {\n let index =<｜fim▁end｜>" Is this the right way to ask for reasoning in this form?

Yindy07 avatar Aug 05 '24 06:08 Yindy07