where is the FastText ptrtrained model to classify each CommonCrawl webpage

[yuhai-china]

First of all: thank you very much for your contribution!

Many thanks if you can share the FastText ptrtrained model to classify each CommonCrawl webpage whether it is low quality page

[xzyaoi]

You can download it here: https://fasttext.cc/docs/en/language-identification.html

[yuhai-china]

You can download it here: https://fasttext.cc/docs/en/language-identification.html

thanks, I want to find the mode to classify the web page whether it is low quality instead of language identification

[Ivan-Zhou]

Hi, @yuhai-china Here's the model file that we trained (link). You can use the script here to load the model and run inference.

I will also add the link of the model weight to our README.

[yuhai-china]

Hi, @yuhai-china Here's the model file that we trained (link). You can use the script here to load the model and run inference.

I will also add the link of the model weight to our README.

thank you very much. it works well