Does openchat use a prompt template?

[sz128]

Great Works!

It seems that openchat.train.json does not utilize a prompt template like what alpaca-lora does.

Do you make experiments about using a prompt template? Will that be better or not?

Thank you!

[imoneoi]

OpenChat added prompt templates during the dataset generation phase. So openchat.train.json already contains a template. Please have a look at openchat.[train/eval].text.json for a better explanation.

We haven't conducted ablation on the prompt template yet. You can do it yourself, about 3 hours of training with 8xA100. We welcome your contributions!

[imoneoi]

Closing this issue now. If you have further questions, plz re-open.