Catgat

DPO Trainer Incorrectly Inserts BoS Before Chosen and Rejected Prompts for Llama3

4

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior The BoS should only appear...

### Name and Version llama.cpp-b3999 ### Operating systems Windows ### GGML backends CUDA ### Hardware 2x RTX 3090 i7-7820X ### Models cgato/Nemo-12b-Humanize-KTO-v0.1 bartowski/Nemo-12b-Humanize-KTO-v0.1-GGUF ### Problem description & steps to reproduce...