ColossalAI
ColossalAI copied to clipboard
[FEATURE]: add parts for unsupervised learning
Describe the feature
Supposed we want a "professional language model" for specific industry (say maritime transportation). Is there a way to train large amont of text data (say papers, books, newspaper) not in the format of Q&A form?
Hi @wanghetongtt Yes, this can be done. However, this is currently beyond the scope of support from the open source community.
Feel free to contact me via email [email protected] to discuss formal collaboration, and you will receive professional high-priority support to help you get your product development done quickly and at low cost. Thanks.