Qwen2.5 icon indicating copy to clipboard operation
Qwen2.5 copied to clipboard

💡 [REQUEST] - <title> finetuning data format question

Open lzl-mt opened this issue 9 months ago • 1 comments

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

Hello, I would like to confirm what the form of finetuning data is. In https://qwen.readthedocs.io/en/latest/training/SFT/example.html, data format likes image

However, in this examples: https://github.com/alibaba/Pai-Megatron-Patch/blob/main/examples/qwen1_5/README.md#Megatron-LM-Dense%E6%A8%A1%E5%9E%8B%E8%AE%AD%E7%BB%83%E6%B5%81%E7%A8%8B, dataset download and extracted like this: image

Thanks!

基本示例 | Basic Example

No

缺陷 | Drawbacks

No

未解决问题 | Unresolved questions

No response

lzl-mt avatar May 20 '24 11:05 lzl-mt