About Quality Classifier

[koanho]

Before Asking 在提问之前

• [X] I have read the README carefully. 我已经仔细阅读了 README 上的操作指引。

• [X] I have pulled the latest code of main branch to run again and the problem still existed. 我已经拉取了主分支上最新的代码，重新运行之后，问题仍不能解决。

Search before asking 先搜索，再提问

• [X] I have searched the Data-Juicer issues and found no similar questions. 我已经在 issue列表 中搜索但是没有发现类似的问题。

Question

Thank you for sharing this great project. I am now attempting to train a Quality Classifier for other languages. Could you please tell me which base architecture (base model) you used for training the Quality Classifier (GPT3, and Chinese)?

Additional 额外信息

No response

[yxdyc]

Thanks for your interest! You can find the details on how to use our provided script to train your own classifier, as well as information about its underlying architecture (based on PySpark and LogisticRegression), in our doc.

[koanho]

Thank you for your kind reply :)