How can I fine-tune the model on some subreddit?

[btseytlin]

Thank you for this model, amazing results.

I would like to take the pretrained model and fine-tune it on r/advice. Such that it generates responses more similar to conversations in that subreddit.

How should I go about it?

[dreasysnail]

Here is my suggestion -- You might want to extract the subreddit data on your own, and follow our pipeline to create a dataset. Then, loading our model as initialization to fine-tune on the small dataset that you created by you own. However, you can be more creative than this :)