DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard
verified publisher icon microsoft

how to train a unsupervised dataset？

Open janelu9 opened this issue 2 years ago • 3 comments

janelu9 avatar Apr 23 '23 09:04 janelu9

Hi @janelu9, can you provide more details?

yaozhewei avatar Apr 24 '23 03:04 yaozhewei

我发现强化学习部分的训练 有可以训练无监督数据是吗？它的原理是什么？根据当前片段的句子直接生成下一个片段的句子吗？

janelu9 avatar Apr 24 '23 09:04 janelu9

我发现强化学习部分的训练 有可以训练无监督数据是吗？它的原理是什么？根据当前片段的句子直接生成下一个片段的句子吗？

janelu9 avatar Apr 24 '23 09:04 janelu9

Yes, it is :) you just need the query/prompt part.

yaozhewei avatar May 01 '23 18:05 yaozhewei

closed due to no followup for 2 weeks.

yaozhewei avatar May 18 '23 21:05 yaozhewei

Yes, it is :) you just need the query/prompt part.

prompt 是 双向attention，answers是单向attention 无监督训练应该是用单向吧

janelu9 avatar May 25 '23 01:05 janelu9