Open-Sora icon indicating copy to clipboard operation
Open-Sora copied to clipboard

Every data pair has text guided during training?

Open yunzhuzhang0918 opened this issue 1 year ago • 3 comments

It seems that only the text guidance model was trained during training, and there was no joint training of the non-text guided generation counter part。 Why is it possible to generate the part when the text is null during inference?

yunzhuzhang0918 avatar Jul 29 '24 03:07 yunzhuzhang0918

In Classifier Free Training process, text is dropped with a certain probability. But I can't find this in opensora v1.2 training scripts However, opensora uses CFG method for inference, which I cannot understand.

yunzhuzhang0918 avatar Jul 29 '24 03:07 yunzhuzhang0918

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Aug 06 '24 01:08 github-actions[bot]

It is implemented in CaptionEmbedder. Have a look at the method token_drop

tyz1994 avatar Aug 12 '24 09:08 tyz1994

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Aug 22 '24 01:08 github-actions[bot]

This issue was closed because it has been inactive for 7 days since being marked as stale.

github-actions[bot] avatar Aug 29 '24 01:08 github-actions[bot]