ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[FEATURE]: add parts for unsupervised learning

Open wanghetongtt opened this issue 1 year ago • 1 comments

Describe the feature

Supposed we want a "professional language model" for specific industry (say maritime transportation). Is there a way to train large amont of text data (say papers, books, newspaper) not in the format of Q&A form?

wanghetongtt avatar Apr 15 '23 06:04 wanghetongtt

Hi @wanghetongtt Yes, this can be done. However, this is currently beyond the scope of support from the open source community.

Feel free to contact me via email [email protected] to discuss formal collaboration, and you will receive professional high-priority support to help you get your product development done quickly and at low cost. Thanks.

binmakeswell avatar Apr 18 '23 07:04 binmakeswell